2024-09-10T07:29:58.794 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T07:29:58.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T07:29:58.951 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872 branch: wip-rishabh-testing-20240909.165402-squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} email: null first_in_suite: false job_id: '7898872' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - SLOW_OPS - slow request sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKC1o464D6J49boVkYD06/qUF9gOfv2tWacBPD0dL2avBOmSlxxNu7sRvCGOjZND6QwW+Sd+Uagh1z6TiBd5kZ0= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBirp7Z07+tA4ajnEZMk+Iuxl3Np3N4u+Om2yvfEL+Rb0NZ/JjneK1GK9bNS2OsQNnylT2tJXRiJ19EMRj+n+ho= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMp5WP/2BQrwteiLLCLpZTPL27XVrYe/3pkj1BnifPy1sd6FELbRAxAGeAp7kosVORecDOmoUz0lxZ84z7YcC4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T07:29:58.951 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T07:29:58.952 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T07:29:58.952 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T07:29:58.953 INFO:teuthology.task.internal:Checking packages... 2024-09-10T07:29:58.976 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T07:29:58.976 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T07:29:58.976 INFO:teuthology.packaging:ref: None 2024-09-10T07:29:58.976 INFO:teuthology.packaging:tag: None 2024-09-10T07:29:58.976 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T07:29:58.976 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:29:58.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T07:29:59.120 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T07:29:59.122 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T07:29:59.127 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T07:29:59.127 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T07:29:59.151 INFO:teuthology.task.internal:Saving configuration 2024-09-10T07:29:59.172 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T07:29:59.178 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T07:29:59.203 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 07:24:36.499217', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKC1o464D6J49boVkYD06/qUF9gOfv2tWacBPD0dL2avBOmSlxxNu7sRvCGOjZND6QwW+Sd+Uagh1z6TiBd5kZ0='} 2024-09-10T07:29:59.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 07:24:36.495680', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBirp7Z07+tA4ajnEZMk+Iuxl3Np3N4u+Om2yvfEL+Rb0NZ/JjneK1GK9bNS2OsQNnylT2tJXRiJ19EMRj+n+ho='} 2024-09-10T07:29:59.243 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 07:24:36.497660', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMp5WP/2BQrwteiLLCLpZTPL27XVrYe/3pkj1BnifPy1sd6FELbRAxAGeAp7kosVORecDOmoUz0lxZ84z7YcC4='} 2024-09-10T07:29:59.243 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T07:29:59.249 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T07:29:59.249 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T07:29:59.249 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T07:29:59.249 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T07:29:59.339 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbf70defbe0>, signals=[15]) 2024-09-10T07:29:59.339 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T07:29:59.345 INFO:teuthology.task.internal:Opening connections... 2024-09-10T07:29:59.346 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T07:29:59.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:29:59.435 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-10T07:29:59.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:29:59.508 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T07:29:59.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:29:59.583 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T07:29:59.590 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-10T07:29:59.609 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-10T07:29:59.609 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-10T07:29:59.667 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-09-10T07:29:59.668 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T07:29:59.669 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T07:29:59.669 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T07:29:59.669 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-10T07:29:59.689 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-10T07:29:59.710 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-10T07:29:59.710 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-10T07:29:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-09-10T07:29:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-09-10T07:29:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-09-10T07:29:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-09-10T07:29:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-09-10T07:29:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-09-10T07:29:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T07:29:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-09-10T07:29:59.769 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-09-10T07:29:59.769 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T07:29:59.769 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-09-10T07:29:59.769 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T07:29:59.769 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T07:29:59.769 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T07:29:59.769 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-10T07:29:59.789 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-09-10T07:29:59.807 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-09-10T07:29:59.807 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-09-10T07:29:59.865 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-09-10T07:29:59.865 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T07:29:59.866 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T07:29:59.867 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-09-10T07:29:59.881 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T07:29:59.890 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T07:29:59.903 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T07:29:59.903 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-10T07:29:59.906 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-10T07:29:59.908 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-09-10T07:29:59.925 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T07:29:59.931 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T07:29:59.931 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-10T07:29:59.964 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-10T07:29:59.966 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-09-10T07:30:00.061 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T07:30:00.118 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T07:30:00.140 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T07:30:00.141 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T07:30:00.141 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T07:30:00.141 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T07:30:00.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:30:00.160 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-10T07:30:00.219 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-503.el9.x86_64 2024-09-10T07:30:00.220 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-503.el9.x86_64 2024-09-10T07:30:00.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-09-10T07:30:03.183 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.2 MB 00:01 2024-09-10T07:30:08.826 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-10T07:30:14.809 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-10T07:30:16.410 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-10T07:30:17.280 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-10T07:30:22.778 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-09-10T07:30:24.859 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T07:30:24.860 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T07:30:24.954 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T07:30:24.964 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T07:30:24.964 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-10T07:30:24.964 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T07:30:24.964 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T07:30:24.964 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T07:30:24.964 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T07:30:24.964 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T07:30:24.964 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T07:30:24.964 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T07:30:24.965 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:30:24.965 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T07:30:24.965 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-10T07:30:24.965 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-09-10T07:30:24.965 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:30:24.965 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 79 M 2024-09-10T07:30:24.965 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 126 M 2024-09-10T07:30:24.965 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T07:30:25.071 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 276 kB/s | 23 kB 00:00 2024-09-10T07:30:27.854 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-10T07:30:28.796 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 7.7 MB/s | 29 MB 00:03 2024-09-10T07:30:29.422 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 7.8 MB/s | 35 MB 00:04 2024-09-10T07:30:29.422 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:30:29.422 INFO:teuthology.orchestra.run.smithi073.stdout:Total 18 MB/s | 79 MB 00:04 2024-09-10T07:30:30.101 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T07:30:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T07:30:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T07:30:31.427 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T07:30:31.428 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T07:30:33.883 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T07:30:34.631 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T07:30:34.730 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T07:30:37.526 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T07:30:37.657 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T07:30:42.479 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T07:30:42.557 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:30:47.415 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:31:25.872 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:31:25.913 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:31:26.299 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:31:26.299 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T07:31:26.299 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T07:31:26.299 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T07:31:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:31:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:31:27.174 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T07:31:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T07:31:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T07:31:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T07:31:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T07:31:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:31:27.174 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T07:31:27.553 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T07:31:27.635 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T07:31:27.635 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T07:31:27.635 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T07:31:27.635 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T07:31:27.635 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T07:31:27.635 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T07:31:27.636 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T07:31:27.636 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T07:31:27.694 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T07:31:27.695 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T07:31:27.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-09-10T07:31:27.736 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-09-10T07:31:27.736 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-09-10T07:31:27.736 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-09-10T07:31:27.736 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 82.el9 2024-09-10T07:31:27.736 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-09-10T07:31:27.736 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8274670 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-09-10T07:31:27.737 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:31:27.738 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T07:31:27.738 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T07:31:27.738 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T07:31:27.738 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-09-10T07:31:27.738 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:31:27.738 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T07:31:27.739 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T07:31:27.739 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-505.el9.x86_64 2024-09-10T07:31:27.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T07:31:28.414 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-10T07:31:29.847 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T07:31:29.862 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-10T07:31:29.864 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-10T07:31:29.921 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.qEjRjNeIa5 2024-09-10T07:31:29.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qEjRjNeIa5 2024-09-10T07:31:29.987 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.qEjRjNeIa5 2024-09-10T07:31:30.133 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.qEjRjNeIa5 is 6KB 2024-09-10T07:31:30.182 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.qEjRjNeIa5 2024-09-10T07:31:30.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T07:31:30.259 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T07:31:30.259 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T07:31:30.259 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T07:31:30.260 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T07:31:30.261 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T07:31:30.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-10T07:32:00.439 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T07:32:00.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T07:32:00.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:32:18.878 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-10T07:32:27.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T07:32:27.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:32:30.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-10T07:32:42.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T07:32:42.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:33:15.112 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-10T07:33:15.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T07:33:15.442 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T07:33:15.442 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-10T07:33:15.457 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-505.el9.x86_64 2024-09-10T07:33:15.457 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T07:33:15.457 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T07:33:15.457 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T07:33:16.459 DEBUG:teuthology.parallel:result is None 2024-09-10T07:33:16.459 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T07:33:16.468 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T07:33:16.468 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T07:33:16.472 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T07:33:16.475 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T07:33:16.493 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T07:33:16.504 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T07:33:16.536 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T07:33:16.536 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T07:33:16.539 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T07:33:16.541 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T07:33:16.643 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T07:33:16.653 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T07:33:16.654 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T07:33:16.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:33:16.671 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T07:33:16.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:33:16.688 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T07:33:16.691 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T07:33:16.714 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T07:33:16.748 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:33:16.764 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:33:16.767 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:33:16.804 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:33:16.805 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:33:16.826 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:33:16.828 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T07:33:16.838 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T07:33:16.839 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T07:33:16.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T07:33:16.844 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T07:33:16.872 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T07:33:16.885 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T07:33:16.885 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T07:33:16.911 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T07:33:16.914 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T07:33:16.930 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:33:17.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:33:17.067 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:33:17.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:33:17.155 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:33:17.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T07:33:17.222 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:33:17.261 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:33:17.369 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:33:17.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:33:17.500 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:33:17.500 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T07:33:17.569 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:33:17.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:33:17.667 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:33:17.750 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:33:17.794 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:33:17.794 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T07:33:17.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-10T07:33:17.862 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-10T07:33:17.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-09-10T07:33:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:33:17.914 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:33:17.935 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:33:18.441 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T07:33:18.448 INFO:teuthology.task.internal:Starting timer... 2024-09-10T07:33:18.449 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T07:33:18.461 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T07:33:18.470 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T07:33:18.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-09-10T07:33:18.541 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-09-10T07:33:18.543 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-09-10T07:33:18.595 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-09-10T07:33:18.597 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2024-09-10T07:33:18.677 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2024-09-10T07:33:18.679 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T07:33:18.679 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-09-10T07:33:18.701 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-09-10T07:33:18.702 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-09-10T07:33:18.729 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-09-10T07:33:18.729 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2024-09-10T07:33:18.762 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2024-09-10T07:33:18.763 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2024-09-10T07:33:18.763 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:33:18.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:33:18.791 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:33:18.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:33:18.822 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:33:18.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:33:18.850 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T07:33:18.850 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-09-10T07:33:18.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-09-10T07:33:18.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2024-09-10T07:33:18.951 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T07:33:18.961 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T07:33:18.964 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T07:33:19.093 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T07:33:19.104 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T07:33:19.105 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi102.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T07:37:17.247 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2024-09-10T07:37:17.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T07:37:17.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:37:17.326 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-10T07:37:17.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-10T07:37:17.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-10T07:37:17.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:37:17.483 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-10T07:37:17.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-10T07:37:17.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-10T07:37:17.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:37:17.642 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-10T07:37:17.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-10T07:37:17.727 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T07:37:17.739 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T07:37:17.739 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T07:37:17.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:37:17.742 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T07:37:17.742 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:37:17.745 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T07:37:17.745 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:37:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T07:37:17.774 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T07:37:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T07:37:17.789 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T07:37:17.798 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T07:37:17.808 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-09-10T07:37:17.813 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T07:37:17.815 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-09-10T07:37:17.819 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-09-10T07:37:17.826 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-09-10T07:37:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T07:37:17.838 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2024-09-10T07:37:17.841 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T07:37:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T07:37:17.849 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2024-09-10T07:37:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T07:37:17.864 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T07:37:17.879 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T07:37:17.909 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:37:17.913 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:37:17.914 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-10T07:37:17.914 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.914 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.914 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.914 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.915 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:37:17.917 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:37:17.917 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-10T07:37:17.917 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.918 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.918 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.918 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.937 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:37:17.941 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:37:17.941 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-10T07:37:17.941 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.942 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.942 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.942 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:37:17.942 INFO:teuthology.run_tasks:Running task install... 2024-09-10T07:37:17.950 DEBUG:teuthology.task.install:project ceph 2024-09-10T07:37:17.950 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T07:37:17.950 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T07:37:17.950 INFO:teuthology.task.install:Using flavor: default 2024-09-10T07:37:17.956 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T07:37:17.956 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T07:37:17.957 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T07:37:17.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:37:17.959 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T07:37:17.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:37:17.961 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T07:37:17.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:37:18.109 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T07:37:18.109 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T07:37:18.121 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T07:37:18.121 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T07:37:18.126 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T07:37:18.127 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T07:37:18.225 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T07:37:18.226 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:37:18.226 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T07:37:18.232 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T07:37:18.232 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:37:18.232 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T07:37:18.237 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T07:37:18.237 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:37:18.237 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T07:37:18.253 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T07:37:18.253 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T07:37:18.258 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T07:37:18.259 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T07:37:18.264 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T07:37:18.264 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T07:37:18.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T07:37:18.324 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T07:37:18.330 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T07:37:18.394 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T07:37:18.399 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T07:37:18.405 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T07:37:18.458 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-09-10T07:37:18.460 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-09-10T07:37:18.464 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2024-09-10T07:37:18.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2024-09-10T07:37:18.469 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-09-10T07:37:18.470 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-09-10T07:37:18.689 INFO:teuthology.orchestra.run.smithi159.stdout:45 files removed 2024-09-10T07:37:18.696 INFO:teuthology.orchestra.run.smithi102.stdout:45 files removed 2024-09-10T07:37:18.700 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-09-10T07:37:18.717 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T07:37:18.722 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T07:37:18.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T07:37:19.274 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-10T07:37:19.276 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-10T07:37:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-10T07:37:19.558 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T07:37:19.560 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T07:37:19.562 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T07:37:19.825 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-10T07:37:19.836 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T07:37:19.838 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T07:37:20.409 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-10T07:37:21.169 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.2 MB 00:01 2024-09-10T07:37:21.879 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:02 2024-09-10T07:37:22.710 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-10T07:37:24.489 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-09-10T07:37:25.315 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 20 MB 00:02 2024-09-10T07:37:28.228 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-10T07:37:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-10T07:37:29.607 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-10T07:37:29.729 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-10T07:37:30.514 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-10T07:37:30.849 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T07:37:31.266 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-10T07:37:31.435 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-10T07:37:32.070 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-10T07:37:36.313 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-10T07:37:36.816 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-10T07:37:37.485 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-10T07:37:38.642 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:37:38.643 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:37:38.656 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T07:37:38.657 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T07:37:38.658 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T07:37:38.659 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T07:37:38.661 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T07:37:38.664 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T07:37:38.665 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T07:37:38.728 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-10T07:37:38.740 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-10T07:37:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-10T07:37:38.740 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T07:37:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T07:37:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T07:37:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T07:37:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T07:37:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T07:37:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T07:37:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T07:37:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T07:37:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T07:37:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T07:37:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T07:37:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T07:37:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T07:37:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T07:37:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T07:37:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T07:37:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T07:37:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T07:37:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T07:37:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout:Install 148 Packages 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 8 Packages 2024-09-10T07:37:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:37:38.754 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 226 M 2024-09-10T07:37:38.754 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-10T07:37:39.153 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:37:39.154 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:37:39.167 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T07:37:39.168 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T07:37:39.169 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T07:37:39.170 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T07:37:39.172 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T07:37:39.175 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T07:37:39.176 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T07:37:39.238 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-10T07:37:39.251 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-09-10T07:37:39.251 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-10T07:37:39.251 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T07:37:39.252 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T07:37:39.253 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-09-10T07:37:39.254 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T07:37:39.255 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T07:37:39.256 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T07:37:39.257 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T07:37:39.258 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T07:37:39.259 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T07:37:39.260 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T07:37:39.261 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T07:37:39.261 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T07:37:39.261 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T07:37:39.261 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T07:37:39.262 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T07:37:39.262 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T07:37:39.262 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T07:37:39.262 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T07:37:39.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T07:37:39.264 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:37:39.265 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-10T07:37:39.266 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-09-10T07:37:39.266 INFO:teuthology.orchestra.run.smithi073.stdout:Install 148 Packages 2024-09-10T07:37:39.266 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 8 Packages 2024-09-10T07:37:39.266 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:37:39.267 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 226 M 2024-09-10T07:37:39.267 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-10T07:37:39.523 INFO:teuthology.orchestra.run.smithi159.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-10T07:37:39.642 INFO:teuthology.orchestra.run.smithi073.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-10T07:37:39.707 INFO:teuthology.orchestra.run.smithi159.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 4.8 MB/s | 897 kB 00:00 2024-09-10T07:37:39.728 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:37:39.729 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:37:39.740 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T07:37:39.741 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T07:37:39.741 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T07:37:39.742 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T07:37:39.744 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T07:37:39.746 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T07:37:39.747 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T07:37:39.782 INFO:teuthology.orchestra.run.smithi159.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.9 MB/s | 145 kB 00:00 2024-09-10T07:37:39.808 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-10T07:37:39.835 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-10T07:37:39.835 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-10T07:37:39.836 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-10T07:37:39.836 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-10T07:37:39.836 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T07:37:39.836 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T07:37:39.836 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T07:37:39.836 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T07:37:39.836 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T07:37:39.837 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T07:37:39.837 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T07:37:39.837 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T07:37:39.837 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T07:37:39.837 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T07:37:39.837 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T07:37:39.837 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T07:37:39.837 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T07:37:39.838 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T07:37:39.838 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T07:37:39.840 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T07:37:39.840 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T07:37:39.840 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T07:37:39.841 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T07:37:39.842 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T07:37:39.843 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T07:37:39.844 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T07:37:39.845 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T07:37:39.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T07:37:39.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T07:37:39.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T07:37:39.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T07:37:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-09-10T07:37:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T07:37:39.852 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:37:39.852 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-10T07:37:39.852 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-10T07:37:39.852 INFO:teuthology.orchestra.run.smithi102.stdout:Install 148 Packages 2024-09-10T07:37:39.852 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 8 Packages 2024-09-10T07:37:39.852 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:37:39.852 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 226 M 2024-09-10T07:37:39.853 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-10T07:37:39.891 INFO:teuthology.orchestra.run.smithi159.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-10T07:37:40.016 INFO:teuthology.orchestra.run.smithi159.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 10 MB/s | 2.4 MB 00:00 2024-09-10T07:37:40.058 INFO:teuthology.orchestra.run.smithi159.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-10T07:37:40.159 INFO:teuthology.orchestra.run.smithi073.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.7 MB/s | 897 kB 00:00 2024-09-10T07:37:40.391 INFO:teuthology.orchestra.run.smithi159.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-10T07:37:40.434 INFO:teuthology.orchestra.run.smithi073.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 528 kB/s | 145 kB 00:00 2024-09-10T07:37:40.750 INFO:teuthology.orchestra.run.smithi159.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 16 MB/s | 21 MB 00:01 2024-09-10T07:37:40.752 INFO:teuthology.orchestra.run.smithi102.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-10T07:37:40.785 INFO:teuthology.orchestra.run.smithi073.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 4.3 MB/s | 5.4 MB 00:01 2024-09-10T07:37:40.800 INFO:teuthology.orchestra.run.smithi159.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 505 kB/s | 25 kB 00:00 2024-09-10T07:37:41.101 INFO:teuthology.orchestra.run.smithi159.stdout:(10/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 16 MB/s | 17 MB 00:01 2024-09-10T07:37:41.126 INFO:teuthology.orchestra.run.smithi073.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 4.5 MB/s | 1.5 MB 00:00 2024-09-10T07:37:41.226 INFO:teuthology.orchestra.run.smithi159.stdout:(11/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 13 MB/s | 11 MB 00:00 2024-09-10T07:37:41.227 INFO:teuthology.orchestra.run.smithi102.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.8 MB/s | 897 kB 00:00 2024-09-10T07:37:41.251 INFO:teuthology.orchestra.run.smithi159.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.5 MB/s | 228 kB 00:00 2024-09-10T07:37:41.276 INFO:teuthology.orchestra.run.smithi159.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 540 kB/s | 27 kB 00:00 2024-09-10T07:37:41.295 INFO:teuthology.orchestra.run.smithi102.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 2.1 MB/s | 145 kB 00:00 2024-09-10T07:37:41.301 INFO:teuthology.orchestra.run.smithi159.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 630 kB/s | 32 kB 00:00 2024-09-10T07:37:41.343 INFO:teuthology.orchestra.run.smithi159.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 751 kB 00:00 2024-09-10T07:37:41.369 INFO:teuthology.orchestra.run.smithi159.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.4 MB/s | 164 kB 00:00 2024-09-10T07:37:41.394 INFO:teuthology.orchestra.run.smithi159.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T07:37:41.418 INFO:teuthology.orchestra.run.smithi073.stdout:(6/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 2.4 MB/s | 2.4 MB 00:00 2024-09-10T07:37:41.427 INFO:teuthology.orchestra.run.smithi159.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 8.5 MB/s | 506 kB 00:00 2024-09-10T07:37:41.495 INFO:teuthology.orchestra.run.smithi159.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 677 kB/s | 45 kB 00:00 2024-09-10T07:37:41.595 INFO:teuthology.orchestra.run.smithi159.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.3 MB/s | 136 kB 00:00 2024-09-10T07:37:41.679 INFO:teuthology.orchestra.run.smithi159.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.9 MB/s | 161 kB 00:00 2024-09-10T07:37:41.770 INFO:teuthology.orchestra.run.smithi159.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 3.4 MB/s | 320 kB 00:00 2024-09-10T07:37:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:(23/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-10T07:37:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 2.1 MB/s | 301 kB 00:00 2024-09-10T07:37:41.929 INFO:teuthology.orchestra.run.smithi102.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 4.1 MB/s | 5.4 MB 00:01 2024-09-10T07:37:41.935 INFO:teuthology.orchestra.run.smithi073.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 5.8 MB/s | 4.7 MB 00:00 2024-09-10T07:37:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T07:37:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-10T07:37:41.987 INFO:teuthology.orchestra.run.smithi102.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 3.4 MB/s | 2.4 MB 00:00 2024-09-10T07:37:42.022 INFO:teuthology.orchestra.run.smithi159.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-10T07:37:42.114 INFO:teuthology.orchestra.run.smithi159.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 347 kB/s | 32 kB 00:00 2024-09-10T07:37:42.196 INFO:teuthology.orchestra.run.smithi102.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 5.7 MB/s | 1.5 MB 00:00 2024-09-10T07:37:42.214 INFO:teuthology.orchestra.run.smithi159.stdout:(29/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-10T07:37:42.240 INFO:teuthology.orchestra.run.smithi159.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.1 MB/s | 146 kB 00:00 2024-09-10T07:37:42.648 INFO:teuthology.orchestra.run.smithi159.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 8.2 MB/s | 3.6 MB 00:00 2024-09-10T07:37:42.732 INFO:teuthology.orchestra.run.smithi159.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.9 MB/s | 249 kB 00:00 2024-09-10T07:37:42.824 INFO:teuthology.orchestra.run.smithi159.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 538 kB/s | 49 kB 00:00 2024-09-10T07:37:42.907 INFO:teuthology.orchestra.run.smithi159.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 197 kB/s | 16 kB 00:00 2024-09-10T07:37:42.991 INFO:teuthology.orchestra.run.smithi159.stdout:(35/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 3.3 MB/s | 285 kB 00:00 2024-09-10T07:37:43.125 INFO:teuthology.orchestra.run.smithi159.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 8.3 MB/s | 7.4 MB 00:00 2024-09-10T07:37:43.167 INFO:teuthology.orchestra.run.smithi159.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 4.3 MB/s | 766 kB 00:00 2024-09-10T07:37:43.192 INFO:teuthology.orchestra.run.smithi159.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 273 kB/s | 18 kB 00:00 2024-09-10T07:37:43.204 INFO:teuthology.orchestra.run.smithi102.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 3.9 MB/s | 4.7 MB 00:01 2024-09-10T07:37:43.309 INFO:teuthology.orchestra.run.smithi159.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-10T07:37:43.734 INFO:teuthology.orchestra.run.smithi159.stdout:(40/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 17 MB/s | 49 MB 00:02 2024-09-10T07:37:43.759 INFO:teuthology.orchestra.run.smithi159.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 424 kB/s | 191 kB 00:00 2024-09-10T07:37:43.794 INFO:teuthology.orchestra.run.smithi073.stdout:(8/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9. 5.7 MB/s | 11 MB 00:01 2024-09-10T07:37:43.844 INFO:teuthology.orchestra.run.smithi073.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 504 kB/s | 25 kB 00:00 2024-09-10T07:37:43.851 INFO:teuthology.orchestra.run.smithi159.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-10T07:37:43.901 INFO:teuthology.orchestra.run.smithi159.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-10T07:37:43.904 INFO:teuthology.orchestra.run.smithi102.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 6.5 MB/s | 21 MB 00:03 2024-09-10T07:37:43.927 INFO:teuthology.orchestra.run.smithi159.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-10T07:37:43.952 INFO:teuthology.orchestra.run.smithi159.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T07:37:43.955 INFO:teuthology.orchestra.run.smithi102.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 504 kB/s | 25 kB 00:00 2024-09-10T07:37:43.977 INFO:teuthology.orchestra.run.smithi159.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T07:37:44.052 INFO:teuthology.orchestra.run.smithi159.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-09-10T07:37:44.113 INFO:teuthology.orchestra.run.smithi102.stdout:(10/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 8.8 MB/s | 17 MB 00:01 2024-09-10T07:37:44.145 INFO:teuthology.orchestra.run.smithi159.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-10T07:37:44.164 INFO:teuthology.orchestra.run.smithi102.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 4.5 MB/s | 228 kB 00:00 2024-09-10T07:37:44.170 INFO:teuthology.orchestra.run.smithi159.stdout:(49/156): python3-urllib3-1.26.5-6.el9.noarch.r 987 kB/s | 215 kB 00:00 2024-09-10T07:37:44.212 INFO:teuthology.orchestra.run.smithi159.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-10T07:37:44.214 INFO:teuthology.orchestra.run.smithi102.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 542 kB/s | 27 kB 00:00 2024-09-10T07:37:44.264 INFO:teuthology.orchestra.run.smithi102.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 636 kB/s | 32 kB 00:00 2024-09-10T07:37:44.270 INFO:teuthology.orchestra.run.smithi159.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-10T07:37:44.304 INFO:teuthology.orchestra.run.smithi159.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 162 kB/s | 22 kB 00:00 2024-09-10T07:37:44.329 INFO:teuthology.orchestra.run.smithi159.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-10T07:37:44.355 INFO:teuthology.orchestra.run.smithi159.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.1 MB/s | 313 kB 00:00 2024-09-10T07:37:44.373 INFO:teuthology.orchestra.run.smithi102.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-10T07:37:44.380 INFO:teuthology.orchestra.run.smithi159.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T07:37:44.405 INFO:teuthology.orchestra.run.smithi159.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T07:37:44.423 INFO:teuthology.orchestra.run.smithi102.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 3.2 MB/s | 164 kB 00:00 2024-09-10T07:37:44.447 INFO:teuthology.orchestra.run.smithi159.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-10T07:37:44.472 INFO:teuthology.orchestra.run.smithi159.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-10T07:37:44.482 INFO:teuthology.orchestra.run.smithi102.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 2.1 MB/s | 127 kB 00:00 2024-09-10T07:37:44.523 INFO:teuthology.orchestra.run.smithi159.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 11 MB/s | 581 kB 00:00 2024-09-10T07:37:44.565 INFO:teuthology.orchestra.run.smithi159.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 589 kB/s | 24 kB 00:00 2024-09-10T07:37:44.574 INFO:teuthology.orchestra.run.smithi102.stdout:(17/156): libradosstriper1-19.1.1-305.g1cf819b7 5.4 MB/s | 506 kB 00:00 2024-09-10T07:37:44.606 INFO:teuthology.orchestra.run.smithi159.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-10T07:37:44.665 INFO:teuthology.orchestra.run.smithi159.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-10T07:37:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:(18/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 7.1 MB/s | 11 MB 00:01 2024-09-10T07:37:44.707 INFO:teuthology.orchestra.run.smithi159.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-10T07:37:44.749 INFO:teuthology.orchestra.run.smithi159.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-10T07:37:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 777 kB/s | 45 kB 00:00 2024-09-10T07:37:44.774 INFO:teuthology.orchestra.run.smithi159.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-10T07:37:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.3 MB/s | 136 kB 00:00 2024-09-10T07:37:44.867 INFO:teuthology.orchestra.run.smithi102.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.7 MB/s | 161 kB 00:00 2024-09-10T07:37:44.961 INFO:teuthology.orchestra.run.smithi102.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 3.4 MB/s | 320 kB 00:00 2024-09-10T07:37:45.058 INFO:teuthology.orchestra.run.smithi159.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-10T07:37:45.084 INFO:teuthology.orchestra.run.smithi102.stdout:(23/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-10T07:37:45.109 INFO:teuthology.orchestra.run.smithi102.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 2.0 MB/s | 301 kB 00:00 2024-09-10T07:37:45.134 INFO:teuthology.orchestra.run.smithi102.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T07:37:45.169 INFO:teuthology.orchestra.run.smithi102.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-10T07:37:45.191 INFO:teuthology.orchestra.run.smithi159.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-10T07:37:45.218 INFO:teuthology.orchestra.run.smithi102.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-10T07:37:45.242 INFO:teuthology.orchestra.run.smithi159.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 18 MB/s | 910 kB 00:00 2024-09-10T07:37:45.269 INFO:teuthology.orchestra.run.smithi102.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 637 kB/s | 32 kB 00:00 2024-09-10T07:37:45.283 INFO:teuthology.orchestra.run.smithi159.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 3.2 MB/s | 137 kB 00:00 2024-09-10T07:37:45.319 INFO:teuthology.orchestra.run.smithi102.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.9 MB/s | 146 kB 00:00 2024-09-10T07:37:45.378 INFO:teuthology.orchestra.run.smithi102.stdout:(30/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-10T07:37:45.426 INFO:teuthology.orchestra.run.smithi159.stdout:(70/156): postgresql-server-13.16-1.el9.x86_64. 41 MB/s | 5.8 MB 00:00 2024-09-10T07:37:45.484 INFO:teuthology.orchestra.run.smithi159.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-10T07:37:45.526 INFO:teuthology.orchestra.run.smithi159.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-10T07:37:45.585 INFO:teuthology.orchestra.run.smithi159.stdout:(73/156): postgresql-13.16-1.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-09-10T07:37:45.619 INFO:teuthology.orchestra.run.smithi073.stdout:(10/156): ceph-common-19.1.1-305.g1cf819b7.el9. 3.5 MB/s | 21 MB 00:06 2024-09-10T07:37:45.652 INFO:teuthology.orchestra.run.smithi159.stdout:(74/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.5 MB/s | 4.9 MB 00:00 2024-09-10T07:37:45.677 INFO:teuthology.orchestra.run.smithi159.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 668 kB/s | 61 kB 00:00 2024-09-10T07:37:45.702 INFO:teuthology.orchestra.run.smithi159.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-10T07:37:45.712 INFO:teuthology.orchestra.run.smithi102.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 9.1 MB/s | 3.6 MB 00:00 2024-09-10T07:37:45.736 INFO:teuthology.orchestra.run.smithi073.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.9 MB/s | 228 kB 00:00 2024-09-10T07:37:45.744 INFO:teuthology.orchestra.run.smithi159.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-10T07:37:45.762 INFO:teuthology.orchestra.run.smithi102.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 4.9 MB/s | 249 kB 00:00 2024-09-10T07:37:45.786 INFO:teuthology.orchestra.run.smithi073.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 543 kB/s | 27 kB 00:00 2024-09-10T07:37:45.812 INFO:teuthology.orchestra.run.smithi102.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 987 kB/s | 49 kB 00:00 2024-09-10T07:37:45.819 INFO:teuthology.orchestra.run.smithi159.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-10T07:37:45.836 INFO:teuthology.orchestra.run.smithi159.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 209 kB/s | 19 kB 00:00 2024-09-10T07:37:45.837 INFO:teuthology.orchestra.run.smithi073.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 635 kB/s | 32 kB 00:00 2024-09-10T07:37:45.862 INFO:teuthology.orchestra.run.smithi159.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-09-10T07:37:45.878 INFO:teuthology.orchestra.run.smithi159.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 829 kB/s | 35 kB 00:00 2024-09-10T07:37:45.904 INFO:teuthology.orchestra.run.smithi159.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-10T07:37:45.921 INFO:teuthology.orchestra.run.smithi102.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-10T07:37:45.929 INFO:teuthology.orchestra.run.smithi159.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-10T07:37:45.946 INFO:teuthology.orchestra.run.smithi102.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 123 kB/s | 16 kB 00:00 2024-09-10T07:37:45.954 INFO:teuthology.orchestra.run.smithi159.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-10T07:37:45.971 INFO:teuthology.orchestra.run.smithi102.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 5.6 MB/s | 285 kB 00:00 2024-09-10T07:37:45.984 INFO:teuthology.orchestra.run.smithi159.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T07:37:45.987 INFO:teuthology.orchestra.run.smithi073.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 4.9 MB/s | 751 kB 00:00 2024-09-10T07:37:45.998 INFO:teuthology.orchestra.run.smithi159.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 975 kB/s | 42 kB 00:00 2024-09-10T07:37:46.022 INFO:teuthology.orchestra.run.smithi102.stdout:(37/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 365 kB/s | 18 kB 00:00 2024-09-10T07:37:46.037 INFO:teuthology.orchestra.run.smithi073.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 3.2 MB/s | 164 kB 00:00 2024-09-10T07:37:46.047 INFO:teuthology.orchestra.run.smithi102.stdout:(38/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 7.4 MB/s | 766 kB 00:00 2024-09-10T07:37:46.057 INFO:teuthology.orchestra.run.smithi159.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-10T07:37:46.082 INFO:teuthology.orchestra.run.smithi159.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-10T07:37:46.087 INFO:teuthology.orchestra.run.smithi073.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T07:37:46.108 INFO:teuthology.orchestra.run.smithi159.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T07:37:46.125 INFO:teuthology.orchestra.run.smithi159.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-10T07:37:46.141 INFO:teuthology.orchestra.run.smithi159.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-10T07:37:46.155 INFO:teuthology.orchestra.run.smithi102.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-10T07:37:46.180 INFO:teuthology.orchestra.run.smithi073.stdout:(17/156): libradosstriper1-19.1.1-305.g1cf819b7 5.4 MB/s | 506 kB 00:00 2024-09-10T07:37:46.233 INFO:teuthology.orchestra.run.smithi159.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-10T07:37:46.239 INFO:teuthology.orchestra.run.smithi102.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-10T07:37:46.259 INFO:teuthology.orchestra.run.smithi159.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-10T07:37:46.284 INFO:teuthology.orchestra.run.smithi159.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-10T07:37:46.309 INFO:teuthology.orchestra.run.smithi159.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T07:37:46.331 INFO:teuthology.orchestra.run.smithi102.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-10T07:37:46.334 INFO:teuthology.orchestra.run.smithi159.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-09-10T07:37:46.359 INFO:teuthology.orchestra.run.smithi159.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-10T07:37:46.381 INFO:teuthology.orchestra.run.smithi102.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-10T07:37:46.393 INFO:teuthology.orchestra.run.smithi159.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T07:37:46.418 INFO:teuthology.orchestra.run.smithi159.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-10T07:37:46.440 INFO:teuthology.orchestra.run.smithi102.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T07:37:46.444 INFO:teuthology.orchestra.run.smithi159.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T07:37:46.469 INFO:teuthology.orchestra.run.smithi159.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T07:37:46.471 INFO:teuthology.orchestra.run.smithi073.stdout:(18/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 3.3 MB/s | 17 MB 00:05 2024-09-10T07:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T07:37:46.494 INFO:teuthology.orchestra.run.smithi159.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-10T07:37:46.521 INFO:teuthology.orchestra.run.smithi073.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 908 kB/s | 45 kB 00:00 2024-09-10T07:37:46.557 INFO:teuthology.orchestra.run.smithi102.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-10T07:37:46.572 INFO:teuthology.orchestra.run.smithi073.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.7 MB/s | 136 kB 00:00 2024-09-10T07:37:46.622 INFO:teuthology.orchestra.run.smithi073.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 3.2 MB/s | 161 kB 00:00 2024-09-10T07:37:46.649 INFO:teuthology.orchestra.run.smithi102.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-10T07:37:46.683 INFO:teuthology.orchestra.run.smithi102.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 3.5 MB/s | 1.2 MB 00:00 2024-09-10T07:37:46.697 INFO:teuthology.orchestra.run.smithi073.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 4.2 MB/s | 320 kB 00:00 2024-09-10T07:37:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-10T07:37:46.773 INFO:teuthology.orchestra.run.smithi073.stdout:(23/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 3.9 MB/s | 301 kB 00:00 2024-09-10T07:37:46.778 INFO:teuthology.orchestra.run.smithi159.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-10T07:37:46.823 INFO:teuthology.orchestra.run.smithi073.stdout:(24/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T07:37:46.825 INFO:teuthology.orchestra.run.smithi102.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-10T07:37:46.828 INFO:teuthology.orchestra.run.smithi159.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-10T07:37:46.854 INFO:teuthology.orchestra.run.smithi159.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-10T07:37:46.873 INFO:teuthology.orchestra.run.smithi073.stdout:(25/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-10T07:37:46.875 INFO:teuthology.orchestra.run.smithi102.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-10T07:37:46.879 INFO:teuthology.orchestra.run.smithi159.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-09-10T07:37:46.904 INFO:teuthology.orchestra.run.smithi159.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T07:37:46.929 INFO:teuthology.orchestra.run.smithi159.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T07:37:46.942 INFO:teuthology.orchestra.run.smithi102.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-09-10T07:37:46.955 INFO:teuthology.orchestra.run.smithi159.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T07:37:46.959 INFO:teuthology.orchestra.run.smithi102.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-10T07:37:46.988 INFO:teuthology.orchestra.run.smithi159.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-10T07:37:47.001 INFO:teuthology.orchestra.run.smithi102.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 787 kB/s | 33 kB 00:00 2024-09-10T07:37:47.026 INFO:teuthology.orchestra.run.smithi102.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-10T07:37:47.038 INFO:teuthology.orchestra.run.smithi159.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T07:37:47.057 INFO:teuthology.orchestra.run.smithi073.stdout:(26/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 6.1 MB/s | 5.3 MB 00:00 2024-09-10T07:37:47.068 INFO:teuthology.orchestra.run.smithi102.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-10T07:37:47.080 INFO:teuthology.orchestra.run.smithi159.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-10T07:37:47.106 INFO:teuthology.orchestra.run.smithi159.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T07:37:47.107 INFO:teuthology.orchestra.run.smithi073.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-10T07:37:47.157 INFO:teuthology.orchestra.run.smithi073.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 639 kB/s | 32 kB 00:00 2024-09-10T07:37:47.173 INFO:teuthology.orchestra.run.smithi159.stdout:(115/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-10T07:37:47.198 INFO:teuthology.orchestra.run.smithi159.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 351 kB/s | 32 kB 00:00 2024-09-10T07:37:47.208 INFO:teuthology.orchestra.run.smithi073.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.9 MB/s | 146 kB 00:00 2024-09-10T07:37:47.223 INFO:teuthology.orchestra.run.smithi159.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-10T07:37:47.248 INFO:teuthology.orchestra.run.smithi159.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T07:37:47.274 INFO:teuthology.orchestra.run.smithi159.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.9 MB/s | 358 kB 00:00 2024-09-10T07:37:47.299 INFO:teuthology.orchestra.run.smithi159.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-10T07:37:47.325 INFO:teuthology.orchestra.run.smithi159.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T07:37:47.358 INFO:teuthology.orchestra.run.smithi159.stdout:(122/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-10T07:37:47.383 INFO:teuthology.orchestra.run.smithi159.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-10T07:37:47.408 INFO:teuthology.orchestra.run.smithi073.stdout:(30/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 5.8 MB/s | 3.1 MB 00:00 2024-09-10T07:37:47.417 INFO:teuthology.orchestra.run.smithi159.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 704 kB/s | 18 kB 00:00 2024-09-10T07:37:47.443 INFO:teuthology.orchestra.run.smithi159.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 998 kB/s | 23 kB 00:00 2024-09-10T07:37:47.467 INFO:teuthology.orchestra.run.smithi159.stdout:(126/156): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-09-10T07:37:47.493 INFO:teuthology.orchestra.run.smithi159.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-10T07:37:47.510 INFO:teuthology.orchestra.run.smithi159.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 468 kB/s | 20 kB 00:00 2024-09-10T07:37:47.519 INFO:teuthology.orchestra.run.smithi102.stdout:(55/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 14 MB/s | 49 MB 00:03 2024-09-10T07:37:47.535 INFO:teuthology.orchestra.run.smithi159.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T07:37:47.544 INFO:teuthology.orchestra.run.smithi102.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-10T07:37:47.560 INFO:teuthology.orchestra.run.smithi159.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T07:37:47.577 INFO:teuthology.orchestra.run.smithi159.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-10T07:37:47.602 INFO:teuthology.orchestra.run.smithi102.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-10T07:37:47.611 INFO:teuthology.orchestra.run.smithi159.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-10T07:37:47.628 INFO:teuthology.orchestra.run.smithi159.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-09-10T07:37:47.653 INFO:teuthology.orchestra.run.smithi102.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-10T07:37:47.675 INFO:teuthology.orchestra.run.smithi073.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 7.6 MB/s | 3.6 MB 00:00 2024-09-10T07:37:47.678 INFO:teuthology.orchestra.run.smithi159.stdout:(134/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-10T07:37:47.703 INFO:teuthology.orchestra.run.smithi159.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T07:37:47.729 INFO:teuthology.orchestra.run.smithi159.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2024-09-10T07:37:47.742 INFO:teuthology.orchestra.run.smithi073.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 3.7 MB/s | 249 kB 00:00 2024-09-10T07:37:47.754 INFO:teuthology.orchestra.run.smithi159.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-10T07:37:47.779 INFO:teuthology.orchestra.run.smithi159.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-09-10T07:37:47.784 INFO:teuthology.orchestra.run.smithi073.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 1.2 MB/s | 49 kB 00:00 2024-09-10T07:37:47.804 INFO:teuthology.orchestra.run.smithi159.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T07:37:47.811 INFO:teuthology.orchestra.run.smithi102.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-10T07:37:47.818 INFO:teuthology.orchestra.run.smithi073.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 497 kB/s | 16 kB 00:00 2024-09-10T07:37:47.834 INFO:teuthology.orchestra.run.smithi159.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-10T07:37:47.856 INFO:teuthology.orchestra.run.smithi159.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-10T07:37:47.862 INFO:teuthology.orchestra.run.smithi102.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-10T07:37:47.881 INFO:teuthology.orchestra.run.smithi159.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-10T07:37:47.887 INFO:teuthology.orchestra.run.smithi102.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-10T07:37:47.906 INFO:teuthology.orchestra.run.smithi159.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-10T07:37:47.912 INFO:teuthology.orchestra.run.smithi102.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-10T07:37:47.931 INFO:teuthology.orchestra.run.smithi159.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-10T07:37:47.956 INFO:teuthology.orchestra.run.smithi159.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-10T07:37:47.981 INFO:teuthology.orchestra.run.smithi159.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T07:37:47.988 INFO:teuthology.orchestra.run.smithi102.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.0 MB/s | 3.0 MB 00:00 2024-09-10T07:37:48.015 INFO:teuthology.orchestra.run.smithi159.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T07:37:48.023 INFO:teuthology.orchestra.run.smithi102.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-10T07:37:48.048 INFO:teuthology.orchestra.run.smithi102.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-10T07:37:48.057 INFO:teuthology.orchestra.run.smithi159.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T07:37:48.073 INFO:teuthology.orchestra.run.smithi102.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 451 kB/s | 38 kB 00:00 2024-09-10T07:37:48.233 INFO:teuthology.orchestra.run.smithi159.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-10T07:37:48.277 INFO:teuthology.orchestra.run.smithi073.stdout:(35/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 11 MB/s | 49 MB 00:04 2024-09-10T07:37:48.302 INFO:teuthology.orchestra.run.smithi073.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 589 kB/s | 285 kB 00:00 2024-09-10T07:37:48.344 INFO:teuthology.orchestra.run.smithi073.stdout:(37/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 439 kB/s | 18 kB 00:00 2024-09-10T07:37:48.366 INFO:teuthology.orchestra.run.smithi159.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 9.0 MB/s | 3.2 MB 00:00 2024-09-10T07:37:48.402 INFO:teuthology.orchestra.run.smithi073.stdout:(38/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 6.0 MB/s | 766 kB 00:00 2024-09-10T07:37:48.415 INFO:teuthology.orchestra.run.smithi102.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.6 MB/s | 1.6 MB 00:00 2024-09-10T07:37:48.444 INFO:teuthology.orchestra.run.smithi073.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 797 kB/s | 80 kB 00:00 2024-09-10T07:37:48.475 INFO:teuthology.orchestra.run.smithi159.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 377 kB/s | 41 kB 00:00 2024-09-10T07:37:48.528 INFO:teuthology.orchestra.run.smithi073.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-10T07:37:48.570 INFO:teuthology.orchestra.run.smithi073.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-10T07:37:48.575 INFO:teuthology.orchestra.run.smithi159.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 4.5 MB/s | 2.3 MB 00:00 2024-09-10T07:37:48.595 INFO:teuthology.orchestra.run.smithi073.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-10T07:37:48.600 INFO:teuthology.orchestra.run.smithi159.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.9 MB/s | 249 kB 00:00 2024-09-10T07:37:48.624 INFO:teuthology.orchestra.run.smithi102.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 4.3 MB/s | 910 kB 00:00 2024-09-10T07:37:48.689 INFO:teuthology.orchestra.run.smithi159.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 4.2 MB/s | 1.8 MB 00:00 2024-09-10T07:37:48.690 INFO:teuthology.orchestra.run.smithi102.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-10T07:37:48.690 INFO:teuthology.orchestra.run.smithi073.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-10T07:37:48.690 INFO:teuthology.orchestra.run.smithi073.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-10T07:37:48.796 INFO:teuthology.orchestra.run.smithi073.stdout:(45/156): ceph-mgr-diskprediction-local-19.1.1- 5.3 MB/s | 7.4 MB 00:01 2024-09-10T07:37:48.800 INFO:teuthology.orchestra.run.smithi159.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-10T07:37:48.821 INFO:teuthology.orchestra.run.smithi073.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 880 kB/s | 125 kB 00:00 2024-09-10T07:37:48.922 INFO:teuthology.orchestra.run.smithi073.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 3.5 MB/s | 1.2 MB 00:00 2024-09-10T07:37:48.942 INFO:teuthology.orchestra.run.smithi102.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.4 MB/s | 4.9 MB 00:00 2024-09-10T07:37:48.947 INFO:teuthology.orchestra.run.smithi073.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-09-10T07:37:49.008 INFO:teuthology.orchestra.run.smithi102.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2024-09-10T07:37:49.067 INFO:teuthology.orchestra.run.smithi102.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T07:37:49.114 INFO:teuthology.orchestra.run.smithi073.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-10T07:37:49.117 INFO:teuthology.orchestra.run.smithi159.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 2.4 MB 00:00 2024-09-10T07:37:49.124 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:37:49.124 INFO:teuthology.orchestra.run.smithi159.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-10T07:37:49.139 INFO:teuthology.orchestra.run.smithi073.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 557 kB/s | 107 kB 00:00 2024-09-10T07:37:49.159 INFO:teuthology.orchestra.run.smithi102.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-10T07:37:49.164 INFO:teuthology.orchestra.run.smithi073.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-10T07:37:49.209 INFO:teuthology.orchestra.run.smithi102.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-10T07:37:49.223 INFO:teuthology.orchestra.run.smithi073.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 33 kB 00:00 2024-09-10T07:37:49.257 INFO:teuthology.orchestra.run.smithi073.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-10T07:37:49.269 INFO:teuthology.orchestra.run.smithi102.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-10T07:37:49.282 INFO:teuthology.orchestra.run.smithi073.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.1 MB/s | 313 kB 00:00 2024-09-10T07:37:49.307 INFO:teuthology.orchestra.run.smithi073.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T07:37:49.326 INFO:teuthology.orchestra.run.smithi102.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-10T07:37:49.332 INFO:teuthology.orchestra.run.smithi073.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T07:37:49.383 INFO:teuthology.orchestra.run.smithi073.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-10T07:37:49.385 INFO:teuthology.orchestra.run.smithi102.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-10T07:37:49.408 INFO:teuthology.orchestra.run.smithi073.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-10T07:37:49.435 INFO:teuthology.orchestra.run.smithi102.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-10T07:37:49.475 INFO:teuthology.orchestra.run.smithi073.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-10T07:37:49.503 INFO:teuthology.orchestra.run.smithi102.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-10T07:37:49.509 INFO:teuthology.orchestra.run.smithi073.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 5.6 MB/s | 581 kB 00:00 2024-09-10T07:37:49.534 INFO:teuthology.orchestra.run.smithi073.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-10T07:37:49.552 INFO:teuthology.orchestra.run.smithi102.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-09-10T07:37:49.560 INFO:teuthology.orchestra.run.smithi073.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-10T07:37:49.618 INFO:teuthology.orchestra.run.smithi073.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-10T07:37:49.668 INFO:teuthology.orchestra.run.smithi073.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 774 kB/s | 38 kB 00:00 2024-09-10T07:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-10T07:37:49.786 INFO:teuthology.orchestra.run.smithi102.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 5.2 MB/s | 5.8 MB 00:01 2024-09-10T07:37:49.870 INFO:teuthology.orchestra.run.smithi102.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-10T07:37:49.962 INFO:teuthology.orchestra.run.smithi102.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-10T07:37:50.020 INFO:teuthology.orchestra.run.smithi102.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T07:37:50.079 INFO:teuthology.orchestra.run.smithi102.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 727 kB/s | 42 kB 00:00 2024-09-10T07:37:50.179 INFO:teuthology.orchestra.run.smithi102.stdout:(86/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.4 MB/s | 6.0 MB 00:01 2024-09-10T07:37:50.205 INFO:teuthology.orchestra.run.smithi102.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-10T07:37:50.238 INFO:teuthology.orchestra.run.smithi102.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-10T07:37:50.319 INFO:teuthology.orchestra.run.smithi073.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-09-10T07:37:50.325 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-10T07:37:50.330 INFO:teuthology.orchestra.run.smithi102.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.6 MB/s | 5.1 MB 00:00 2024-09-10T07:37:50.355 INFO:teuthology.orchestra.run.smithi102.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-09-10T07:37:50.381 INFO:teuthology.orchestra.run.smithi102.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 359 kB/s | 51 kB 00:00 2024-09-10T07:37:50.406 INFO:teuthology.orchestra.run.smithi102.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-10T07:37:50.431 INFO:teuthology.orchestra.run.smithi102.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-10T07:37:50.457 INFO:teuthology.orchestra.run.smithi102.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-10T07:37:50.478 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-10T07:37:50.478 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-10T07:37:50.490 INFO:teuthology.orchestra.run.smithi102.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T07:37:50.516 INFO:teuthology.orchestra.run.smithi102.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-10T07:37:50.541 INFO:teuthology.orchestra.run.smithi102.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-10T07:37:50.591 INFO:teuthology.orchestra.run.smithi102.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T07:37:50.616 INFO:teuthology.orchestra.run.smithi102.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-10T07:37:50.650 INFO:teuthology.orchestra.run.smithi102.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T07:37:50.675 INFO:teuthology.orchestra.run.smithi102.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T07:37:50.701 INFO:teuthology.orchestra.run.smithi102.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-10T07:37:50.943 INFO:teuthology.orchestra.run.smithi102.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-10T07:37:51.001 INFO:teuthology.orchestra.run.smithi102.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T07:37:51.035 INFO:teuthology.orchestra.run.smithi102.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T07:37:51.060 INFO:teuthology.orchestra.run.smithi102.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-10T07:37:51.111 INFO:teuthology.orchestra.run.smithi073.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-10T07:37:51.169 INFO:teuthology.orchestra.run.smithi102.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-10T07:37:51.194 INFO:teuthology.orchestra.run.smithi102.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T07:37:51.219 INFO:teuthology.orchestra.run.smithi102.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T07:37:51.244 INFO:teuthology.orchestra.run.smithi102.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T07:37:51.270 INFO:teuthology.orchestra.run.smithi102.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-10T07:37:51.311 INFO:teuthology.orchestra.run.smithi102.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-10T07:37:51.345 INFO:teuthology.orchestra.run.smithi102.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-10T07:37:51.370 INFO:teuthology.orchestra.run.smithi102.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T07:37:51.396 INFO:teuthology.orchestra.run.smithi102.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2024-09-10T07:37:51.421 INFO:teuthology.orchestra.run.smithi102.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-10T07:37:51.447 INFO:teuthology.orchestra.run.smithi102.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-10T07:37:51.489 INFO:teuthology.orchestra.run.smithi102.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-10T07:37:51.531 INFO:teuthology.orchestra.run.smithi102.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-09-10T07:37:51.564 INFO:teuthology.orchestra.run.smithi102.stdout:(120/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-10T07:37:51.594 INFO:teuthology.orchestra.run.smithi073.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 1.8 MB/s | 910 kB 00:00 2024-09-10T07:37:51.598 INFO:teuthology.orchestra.run.smithi102.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-10T07:37:51.623 INFO:teuthology.orchestra.run.smithi102.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 6.1 MB/s | 144 kB 00:00 2024-09-10T07:37:51.648 INFO:teuthology.orchestra.run.smithi102.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-10T07:37:51.673 INFO:teuthology.orchestra.run.smithi102.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-10T07:37:51.699 INFO:teuthology.orchestra.run.smithi102.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-10T07:37:51.720 INFO:teuthology.orchestra.run.smithi073.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-10T07:37:51.725 INFO:teuthology.orchestra.run.smithi102.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-10T07:37:51.749 INFO:teuthology.orchestra.run.smithi102.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-10T07:37:51.825 INFO:teuthology.orchestra.run.smithi102.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-10T07:37:51.859 INFO:teuthology.orchestra.run.smithi102.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-09-10T07:37:51.870 INFO:teuthology.orchestra.run.smithi073.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.2 MB/s | 4.9 MB 00:02 2024-09-10T07:37:51.884 INFO:teuthology.orchestra.run.smithi102.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 790 kB/s | 46 kB 00:00 2024-09-10T07:37:51.909 INFO:teuthology.orchestra.run.smithi102.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-10T07:37:51.935 INFO:teuthology.orchestra.run.smithi102.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T07:37:51.960 INFO:teuthology.orchestra.run.smithi102.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-10T07:37:51.970 INFO:teuthology.orchestra.run.smithi073.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-10T07:37:51.985 INFO:teuthology.orchestra.run.smithi102.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-10T07:37:52.010 INFO:teuthology.orchestra.run.smithi102.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T07:37:52.036 INFO:teuthology.orchestra.run.smithi102.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T07:37:52.045 INFO:teuthology.orchestra.run.smithi073.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-10T07:37:52.069 INFO:teuthology.orchestra.run.smithi102.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-09-10T07:37:52.095 INFO:teuthology.orchestra.run.smithi102.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-10T07:37:52.120 INFO:teuthology.orchestra.run.smithi102.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T07:37:52.145 INFO:teuthology.orchestra.run.smithi102.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-10T07:37:52.171 INFO:teuthology.orchestra.run.smithi102.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T07:37:52.196 INFO:teuthology.orchestra.run.smithi102.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-10T07:37:52.230 INFO:teuthology.orchestra.run.smithi102.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-10T07:37:52.263 INFO:teuthology.orchestra.run.smithi102.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 600 kB/s | 20 kB 00:00 2024-09-10T07:37:52.275 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-10T07:37:52.276 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-10T07:37:52.305 INFO:teuthology.orchestra.run.smithi102.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-10T07:37:52.462 INFO:teuthology.orchestra.run.smithi073.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-09-10T07:37:52.472 INFO:teuthology.orchestra.run.smithi102.stdout:(146/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.7 MB/s | 16 MB 00:02 2024-09-10T07:37:52.506 INFO:teuthology.orchestra.run.smithi102.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 790 kB/s | 191 kB 00:00 2024-09-10T07:37:52.521 INFO:teuthology.orchestra.run.smithi073.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi102.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2024-09-10T07:37:52.680 INFO:teuthology.orchestra.run.smithi073.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-10T07:37:52.838 INFO:teuthology.orchestra.run.smithi073.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-10T07:37:52.897 INFO:teuthology.orchestra.run.smithi073.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-09-10T07:37:52.957 INFO:teuthology.orchestra.run.smithi073.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-09-10T07:37:52.957 INFO:teuthology.orchestra.run.smithi102.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 7.0 MB/s | 3.2 MB 00:00 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi102.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 5.5 MB/s | 2.3 MB 00:00 2024-09-10T07:37:53.066 INFO:teuthology.orchestra.run.smithi102.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 700 kB/s | 41 kB 00:00 2024-09-10T07:37:53.072 INFO:teuthology.orchestra.run.smithi073.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-10T07:37:53.115 INFO:teuthology.orchestra.run.smithi102.stdout:(152/156): librados2-19.1.1-305.g1cf819b7.el9.x 5.3 MB/s | 3.4 MB 00:00 2024-09-10T07:37:53.122 INFO:teuthology.orchestra.run.smithi073.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-10T07:37:53.149 INFO:teuthology.orchestra.run.smithi102.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-10T07:37:53.258 INFO:teuthology.orchestra.run.smithi102.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 6.0 MB/s | 1.8 MB 00:00 2024-09-10T07:37:53.383 INFO:teuthology.orchestra.run.smithi102.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 1.4 MB 00:00 2024-09-10T07:37:53.483 INFO:teuthology.orchestra.run.smithi102.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.2 MB/s | 2.4 MB 00:00 2024-09-10T07:37:53.488 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:37:53.488 INFO:teuthology.orchestra.run.smithi102.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-10T07:37:54.565 INFO:teuthology.orchestra.run.smithi073.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 2.0 MB/s | 5.8 MB 00:02 2024-09-10T07:37:54.728 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-10T07:37:54.731 INFO:teuthology.orchestra.run.smithi073.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-10T07:37:54.832 INFO:teuthology.orchestra.run.smithi073.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.1 MB/s | 6.0 MB 00:02 2024-09-10T07:37:54.878 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-10T07:37:54.878 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-10T07:37:54.916 INFO:teuthology.orchestra.run.smithi073.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 928 kB/s | 77 kB 00:00 2024-09-10T07:37:54.941 INFO:teuthology.orchestra.run.smithi073.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 222 kB 00:00 2024-09-10T07:37:54.977 INFO:teuthology.orchestra.run.smithi073.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 696 kB/s | 42 kB 00:00 2024-09-10T07:37:55.143 INFO:teuthology.orchestra.run.smithi073.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 953 kB/s | 159 kB 00:00 2024-09-10T07:37:55.169 INFO:teuthology.orchestra.run.smithi073.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 1.2 MB/s | 269 kB 00:00 2024-09-10T07:37:55.219 INFO:teuthology.orchestra.run.smithi073.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T07:37:55.269 INFO:teuthology.orchestra.run.smithi073.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T07:37:55.311 INFO:teuthology.orchestra.run.smithi073.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-09-10T07:37:55.362 INFO:teuthology.orchestra.run.smithi073.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-10T07:37:55.478 INFO:teuthology.orchestra.run.smithi073.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.2 MB/s | 5.1 MB 00:02 2024-09-10T07:37:55.504 INFO:teuthology.orchestra.run.smithi073.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 312 kB/s | 44 kB 00:00 2024-09-10T07:37:55.554 INFO:teuthology.orchestra.run.smithi073.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-10T07:37:55.613 INFO:teuthology.orchestra.run.smithi073.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-09-10T07:37:55.638 INFO:teuthology.orchestra.run.smithi073.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-10T07:37:55.696 INFO:teuthology.orchestra.run.smithi073.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 992 kB/s | 58 kB 00:00 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi073.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-10T07:37:55.814 INFO:teuthology.orchestra.run.smithi073.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-10T07:37:55.864 INFO:teuthology.orchestra.run.smithi073.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2024-09-10T07:37:55.881 INFO:teuthology.orchestra.run.smithi073.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-10T07:37:56.423 INFO:teuthology.orchestra.run.smithi073.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2024-09-10T07:37:56.490 INFO:teuthology.orchestra.run.smithi073.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-10T07:37:56.532 INFO:teuthology.orchestra.run.smithi073.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-10T07:37:56.548 INFO:teuthology.orchestra.run.smithi073.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-10T07:37:56.689 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-10T07:37:56.690 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-10T07:37:56.740 INFO:teuthology.orchestra.run.smithi073.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-10T07:37:56.766 INFO:teuthology.orchestra.run.smithi073.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T07:37:56.791 INFO:teuthology.orchestra.run.smithi073.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T07:37:56.825 INFO:teuthology.orchestra.run.smithi073.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 915 kB/s | 863 kB 00:00 2024-09-10T07:37:56.850 INFO:teuthology.orchestra.run.smithi073.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-10T07:37:56.908 INFO:teuthology.orchestra.run.smithi073.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T07:37:56.942 INFO:teuthology.orchestra.run.smithi073.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-09-10T07:37:56.967 INFO:teuthology.orchestra.run.smithi073.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-10T07:37:56.993 INFO:teuthology.orchestra.run.smithi073.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 866 kB/s | 43 kB 00:00 2024-09-10T07:37:57.018 INFO:teuthology.orchestra.run.smithi073.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 636 kB/s | 32 kB 00:00 2024-09-10T07:37:57.043 INFO:teuthology.orchestra.run.smithi073.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-10T07:37:57.069 INFO:teuthology.orchestra.run.smithi073.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-10T07:37:57.102 INFO:teuthology.orchestra.run.smithi073.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T07:37:57.128 INFO:teuthology.orchestra.run.smithi073.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-10T07:37:57.153 INFO:teuthology.orchestra.run.smithi073.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T07:37:57.187 INFO:teuthology.orchestra.run.smithi073.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T07:37:57.220 INFO:teuthology.orchestra.run.smithi073.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 321 kB/s | 11 kB 00:00 2024-09-10T07:37:57.257 INFO:teuthology.orchestra.run.smithi073.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 533 kB/s | 18 kB 00:00 2024-09-10T07:37:57.296 INFO:teuthology.orchestra.run.smithi073.stdout:(125/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-09-10T07:37:57.321 INFO:teuthology.orchestra.run.smithi073.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 346 kB/s | 23 kB 00:00 2024-09-10T07:37:57.346 INFO:teuthology.orchestra.run.smithi073.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-10T07:37:57.372 INFO:teuthology.orchestra.run.smithi073.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-10T07:37:57.405 INFO:teuthology.orchestra.run.smithi073.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-10T07:37:57.439 INFO:teuthology.orchestra.run.smithi073.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-09-10T07:37:57.464 INFO:teuthology.orchestra.run.smithi073.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-10T07:37:57.489 INFO:teuthology.orchestra.run.smithi073.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi073.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-10T07:37:57.540 INFO:teuthology.orchestra.run.smithi073.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-10T07:37:57.565 INFO:teuthology.orchestra.run.smithi073.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T07:37:57.590 INFO:teuthology.orchestra.run.smithi073.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-10T07:37:57.616 INFO:teuthology.orchestra.run.smithi073.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-10T07:37:57.641 INFO:teuthology.orchestra.run.smithi073.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-10T07:37:57.666 INFO:teuthology.orchestra.run.smithi073.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T07:37:57.691 INFO:teuthology.orchestra.run.smithi073.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T07:37:57.717 INFO:teuthology.orchestra.run.smithi073.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T07:37:57.742 INFO:teuthology.orchestra.run.smithi073.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-10T07:37:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T07:37:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:(144/156): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-09-10T07:37:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-09-10T07:37:57.852 INFO:teuthology.orchestra.run.smithi073.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T07:37:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T07:37:58.286 INFO:teuthology.orchestra.run.smithi073.stdout:(148/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 8.4 MB/s | 3.2 MB 00:00 2024-09-10T07:37:58.444 INFO:teuthology.orchestra.run.smithi073.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 5.8 MB/s | 3.4 MB 00:00 2024-09-10T07:37:58.618 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-10T07:37:58.738 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T07:37:58.776 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T07:37:58.829 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T07:37:58.863 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T07:37:58.887 INFO:teuthology.orchestra.run.smithi073.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 4.1 MB/s | 1.8 MB 00:00 2024-09-10T07:37:58.889 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T07:37:58.932 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T07:37:58.945 INFO:teuthology.orchestra.run.smithi073.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 3.5 MB/s | 2.3 MB 00:00 2024-09-10T07:37:58.970 INFO:teuthology.orchestra.run.smithi073.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 488 kB/s | 41 kB 00:00 2024-09-10T07:37:59.046 INFO:teuthology.orchestra.run.smithi073.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.4 MB/s | 249 kB 00:00 2024-09-10T07:37:59.254 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T07:37:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:37:59.379 INFO:teuthology.orchestra.run.smithi073.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 1.4 MB 00:00 2024-09-10T07:37:59.504 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:37:59.524 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:37:59.615 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:37:59.645 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:37:59.771 INFO:teuthology.orchestra.run.smithi073.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-09-10T07:37:59.796 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T07:37:59.858 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T07:37:59.878 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:37:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:37:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:38:00.033 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:38:00.055 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:38:00.079 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:38:00.257 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:38:00.402 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:38:00.545 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T07:38:00.629 INFO:teuthology.orchestra.run.smithi073.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.0 MB/s | 16 MB 00:05 2024-09-10T07:38:00.634 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:38:00.634 INFO:teuthology.orchestra.run.smithi073.stdout:Total 11 MB/s | 226 MB 00:21 2024-09-10T07:38:00.635 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:38:00.714 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:38:00.945 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:38:01.060 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T07:38:01.156 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T07:38:01.194 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T07:38:01.228 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T07:38:01.314 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T07:38:01.362 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T07:38:01.394 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T07:38:01.438 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T07:38:01.470 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T07:38:01.498 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T07:38:01.566 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T07:38:01.620 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T07:38:01.651 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T07:38:01.686 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T07:38:01.764 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T07:38:01.798 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T07:38:01.828 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-10T07:38:01.840 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T07:38:01.869 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T07:38:01.938 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T07:38:01.977 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-10T07:38:01.977 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-10T07:38:01.984 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T07:38:02.057 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T07:38:02.190 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T07:38:02.236 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T07:38:02.749 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T07:38:02.831 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T07:38:02.861 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T07:38:02.904 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T07:38:02.962 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T07:38:03.008 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T07:38:03.080 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-10T07:38:03.164 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T07:38:03.172 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T07:38:03.209 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T07:38:03.232 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T07:38:03.270 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T07:38:03.286 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T07:38:03.304 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T07:38:03.330 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T07:38:03.367 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T07:38:03.381 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T07:38:03.399 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T07:38:03.435 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T07:38:03.482 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T07:38:03.518 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T07:38:03.561 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T07:38:03.603 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T07:38:03.701 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T07:38:03.740 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T07:38:03.788 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T07:38:03.798 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:38:03.829 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T07:38:03.903 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:38:03.932 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T07:38:03.932 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:38:03.963 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T07:38:03.994 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T07:38:04.018 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:38:04.020 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T07:38:04.045 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T07:38:04.049 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:38:04.120 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T07:38:04.201 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T07:38:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T07:38:04.258 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T07:38:04.277 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-10T07:38:04.277 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-10T07:38:04.286 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:38:04.366 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T07:38:04.391 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:38:04.413 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:38:04.475 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:38:04.497 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:38:04.522 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:38:04.641 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T07:38:04.673 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:38:04.701 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T07:38:04.740 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T07:38:04.779 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T07:38:04.798 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:38:04.809 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T07:38:04.843 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T07:38:04.885 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T07:38:04.920 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T07:38:04.927 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T07:38:04.961 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T07:38:05.017 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:38:05.051 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T07:38:05.105 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:38:05.107 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T07:38:05.138 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T07:38:05.241 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T07:38:05.297 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T07:38:05.327 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:38:05.449 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T07:38:05.542 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T07:38:05.577 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T07:38:05.612 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T07:38:05.686 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T07:38:05.730 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T07:38:05.770 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T07:38:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T07:38:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T07:38:05.874 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T07:38:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T07:38:06.005 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T07:38:06.019 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T07:38:06.035 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T07:38:06.079 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T07:38:06.155 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T07:38:06.161 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T07:38:06.189 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T07:38:06.195 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T07:38:06.232 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T07:38:06.261 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T07:38:06.294 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T07:38:06.335 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T07:38:06.350 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T07:38:06.380 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T07:38:06.395 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T07:38:06.454 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T07:38:06.483 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T07:38:06.523 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T07:38:06.589 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T07:38:06.649 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T07:38:06.707 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T07:38:06.729 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T07:38:06.798 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T07:38:07.186 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T07:38:07.261 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T07:38:07.299 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T07:38:07.350 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T07:38:07.396 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T07:38:07.438 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T07:38:07.450 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T07:38:07.577 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T07:38:07.586 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T07:38:07.641 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T07:38:07.696 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T07:38:07.768 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T07:38:07.809 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T07:38:07.845 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T07:38:07.891 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T07:38:07.928 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T07:38:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T07:38:08.021 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T07:38:08.158 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T07:38:08.200 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T07:38:08.241 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T07:38:08.342 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T07:38:08.383 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T07:38:08.496 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T07:38:08.766 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T07:38:08.788 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T07:38:08.790 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T07:38:08.871 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T07:38:08.875 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T07:38:08.902 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T07:38:08.935 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T07:38:08.993 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T07:38:09.039 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T07:38:09.067 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T07:38:09.101 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T07:38:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T07:38:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T07:38:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T07:38:09.243 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T07:38:09.253 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T07:38:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T07:38:09.298 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:38:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T07:38:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T07:38:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:38:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T07:38:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T07:38:09.453 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T07:38:09.501 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T07:38:09.532 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T07:38:09.644 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T07:38:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T07:38:09.928 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T07:38:10.045 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:38:10.100 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:38:10.130 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T07:38:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T07:38:10.464 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T07:38:10.498 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T07:38:10.599 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T07:38:10.661 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T07:38:10.706 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T07:38:10.794 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T07:38:10.825 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T07:38:10.879 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-10T07:38:10.983 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T07:38:11.016 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T07:38:11.021 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T07:38:11.057 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T07:38:11.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T07:38:11.108 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T07:38:11.134 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T07:38:11.144 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T07:38:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T07:38:11.526 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T07:38:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:38:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:38:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:38:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T07:38:11.870 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:38:11.899 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:38:12.005 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T07:38:12.071 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T07:38:12.137 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T07:38:12.165 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:38:12.270 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:38:12.299 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:38:12.372 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:38:12.402 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:38:12.404 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:38:12.430 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:38:12.443 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:38:12.655 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:38:12.837 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:38:12.975 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T07:38:12.985 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:38:13.021 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:38:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:38:13.111 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:38:13.111 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T07:38:13.111 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T07:38:13.111 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:13.139 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:38:13.185 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:38:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T07:38:13.329 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T07:38:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T07:38:13.390 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T07:38:13.423 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:38:13.542 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T07:38:13.636 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T07:38:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T07:38:13.698 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T07:38:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:38:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T07:38:13.817 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T07:38:13.835 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:38:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T07:38:13.866 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T07:38:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T07:38:13.902 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T07:38:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T07:38:13.953 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T07:38:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T07:38:14.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T07:38:14.115 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T07:38:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T07:38:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T07:38:14.326 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T07:38:14.357 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T07:38:14.380 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T07:38:14.414 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:38:14.427 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T07:38:14.471 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T07:38:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:38:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T07:38:14.545 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T07:38:14.684 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T07:38:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T07:38:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T07:38:15.368 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T07:38:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T07:38:15.434 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T07:38:15.471 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T07:38:15.513 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T07:38:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T07:38:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T07:38:15.803 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T07:38:15.867 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T07:38:15.900 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T07:38:15.936 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T07:38:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T07:38:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T07:38:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T07:38:16.103 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T07:38:16.238 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T07:38:16.281 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T07:38:16.322 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T07:38:16.422 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T07:38:16.457 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T07:38:16.496 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T07:38:16.538 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T07:38:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T07:38:16.651 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T07:38:16.779 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T07:38:16.811 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T07:38:16.813 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:38:16.839 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T07:38:16.846 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:38:16.884 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T07:38:16.921 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T07:38:16.953 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T07:38:16.983 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T07:38:17.017 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T07:38:17.050 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T07:38:17.092 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T07:38:17.126 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T07:38:17.212 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T07:38:17.256 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T07:38:17.296 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T07:38:17.390 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:38:17.398 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T07:38:17.433 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:38:17.446 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T07:38:17.534 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:38:17.534 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T07:38:17.534 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T07:38:17.534 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:17.576 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:38:18.152 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T07:38:18.203 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T07:38:18.236 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T07:38:18.325 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T07:38:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T07:38:18.431 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T07:38:18.517 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T07:38:18.551 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T07:38:18.733 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T07:38:18.766 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T07:38:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T07:38:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T07:38:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T07:38:20.838 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T07:38:20.928 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T07:38:20.956 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T07:38:20.981 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T07:38:21.295 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T07:38:21.345 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:38:21.434 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:38:21.466 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T07:38:21.502 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T07:38:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T07:38:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:38:22.068 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:38:22.099 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T07:38:24.408 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:38:24.437 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:38:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:38:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:38:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:38:25.126 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T07:38:25.126 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T07:38:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:25.167 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:38:25.190 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:38:25.190 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2024-09-10T07:38:25.190 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2024-09-10T07:38:25.190 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2024-09-10T07:38:25.190 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2024-09-10T07:38:25.190 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2024-09-10T07:38:25.190 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2024-09-10T07:38:25.190 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2024-09-10T07:38:25.190 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:25.359 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:38:25.375 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:38:25.375 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:25.375 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T07:38:25.375 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:26.863 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:38:26.890 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:38:26.890 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:26.890 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T07:38:26.890 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:38:26.890 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:38:26.890 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:27.121 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:38:27.145 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:38:27.145 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:27.145 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T07:38:27.145 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:38:27.145 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:38:27.148 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:27.581 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:38:27.604 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:38:27.604 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:27.604 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T07:38:27.604 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:38:27.604 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:38:27.604 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T07:38:27.768 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T07:38:27.823 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T07:38:28.010 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T07:38:28.073 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T07:38:28.151 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T07:38:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T07:38:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T07:38:28.424 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T07:38:28.455 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T07:38:28.483 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T07:38:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:38:28.956 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:38:28.988 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T07:38:29.050 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T07:38:29.079 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:38:29.441 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:38:29.441 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-09-10T07:38:29.442 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-09-10T07:38:29.442 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-09-10T07:38:29.442 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-09-10T07:38:29.442 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-09-10T07:38:29.442 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-09-10T07:38:29.442 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-09-10T07:38:29.442 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:29.622 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:38:29.638 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:38:29.638 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:29.638 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T07:38:29.639 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:30.121 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:38:30.156 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:38:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:38:31.122 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:38:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:38:31.135 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:31.135 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T07:38:31.135 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:38:31.135 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:38:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:31.156 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:38:31.260 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:38:31.359 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:38:31.382 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:38:31.382 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:31.382 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T07:38:31.383 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:38:31.383 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:38:31.383 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:31.427 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T07:38:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:38:31.483 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:38:31.483 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:31.483 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T07:38:31.483 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:38:31.483 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:38:31.483 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:31.551 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:38:31.562 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:38:31.669 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T07:38:31.716 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T07:38:31.826 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:38:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:38:31.850 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:31.850 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T07:38:31.850 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:38:31.850 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:38:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:31.956 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T07:38:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T07:38:32.077 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T07:38:32.262 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T07:38:32.318 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T07:38:32.397 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T07:38:32.486 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T07:38:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T07:38:32.645 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T07:38:32.670 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:38:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T07:38:32.693 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:38:32.693 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:32.693 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T07:38:32.693 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:38:32.693 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:38:32.694 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T07:38:32.729 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:38:32.736 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T07:38:32.751 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:38:32.752 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:32.752 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T07:38:32.752 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:32.797 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:38:32.820 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:38:32.820 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:32.820 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T07:38:32.820 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:38:32.820 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:38:32.820 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:38:33.153 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:38:33.153 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:33.154 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T07:38:33.154 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:38:33.154 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:38:33.154 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:38:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:38:33.249 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T07:38:33.312 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T07:38:33.342 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:38:34.386 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:38:34.427 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:38:35.387 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:38:35.419 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:38:35.522 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:38:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T07:38:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:38:35.748 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:38:35.748 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:35.748 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T07:38:35.748 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:38:35.748 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:38:35.748 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:35.797 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:38:35.809 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:38:35.906 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T07:38:35.987 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T07:38:36.913 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T07:38:36.941 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:38:36.965 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:38:36.965 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:36.965 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T07:38:36.965 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:38:36.965 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:38:36.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:37.017 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:38:37.040 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:38:37.040 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:37.040 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T07:38:37.040 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:37.101 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:38:37.124 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:38:37.125 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:37.125 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T07:38:37.125 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:38:37.125 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:38:37.125 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:37.195 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:38:37.196 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-09-10T07:38:37.196 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-09-10T07:38:37.196 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-09-10T07:38:37.196 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-09-10T07:38:37.196 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-09-10T07:38:37.196 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-09-10T07:38:37.196 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-09-10T07:38:37.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:37.372 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:38:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:38:37.389 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:37.389 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T07:38:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:37.435 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:38:37.458 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:38:37.459 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:37.459 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T07:38:37.459 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:38:37.459 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:38:37.459 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:37.685 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T07:38:37.726 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T07:38:37.767 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T07:38:37.799 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T07:38:37.826 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T07:38:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T07:38:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T07:38:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T07:38:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T07:38:38.154 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T07:38:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:38:38.819 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:38:38.839 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:38:38.900 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:38:38.927 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:38:38.927 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:38.927 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T07:38:38.927 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:38:38.927 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:38:38.928 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:39.151 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:38:39.174 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:38:39.174 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:39.174 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T07:38:39.174 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:38:39.174 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:38:39.174 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:39.610 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:38:39.633 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:38:39.633 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:39.633 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T07:38:39.634 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:38:39.634 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:38:39.634 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:39.685 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T07:38:39.731 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T07:38:39.765 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T07:38:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T07:38:39.806 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T07:38:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T07:38:39.888 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T07:38:39.934 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T07:38:39.960 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T07:38:39.986 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T07:38:39.986 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:38:40.027 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T07:38:40.069 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T07:38:40.070 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:38:40.070 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:38:40.137 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T07:38:40.154 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:38:40.179 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T07:38:40.184 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:38:40.184 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:38:40.225 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T07:38:40.355 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T07:38:40.373 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:38:40.373 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:38:40.403 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T07:38:40.434 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T07:38:40.457 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:38:40.462 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T07:38:40.521 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:38:40.907 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:38:40.958 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:38:40.992 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T07:38:41.054 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T07:38:41.084 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:38:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T07:38:42.038 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T07:38:42.080 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T07:38:42.112 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T07:38:42.117 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:38:42.139 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T07:38:42.160 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:38:42.325 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T07:38:42.377 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T07:38:42.407 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T07:38:42.437 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T07:38:42.492 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T07:38:43.114 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:38:43.115 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:38:43.144 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:38:43.156 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:38:43.177 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:38:43.245 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:38:43.414 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T07:38:43.446 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:38:43.471 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:38:43.471 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:43.471 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T07:38:43.471 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:38:43.471 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:38:43.471 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:43.522 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:38:43.534 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:38:43.631 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T07:38:43.696 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T07:38:44.024 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T07:38:44.103 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T07:38:44.144 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T07:38:44.227 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T07:38:44.264 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T07:38:44.290 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T07:38:44.316 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T07:38:44.316 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:38:44.408 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:38:44.408 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:38:44.492 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:38:44.517 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T07:38:44.523 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:38:44.523 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:38:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T07:38:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:38:44.674 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:38:44.674 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:44.674 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T07:38:44.674 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:38:44.675 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:38:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:44.702 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:38:44.702 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:38:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:38:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:38:44.740 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:44.740 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T07:38:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:38:44.795 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:38:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:38:44.816 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:44.816 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T07:38:44.816 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:38:44.816 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:38:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:38:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:38:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:38:45.142 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:38:45.142 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T07:38:45.142 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:38:45.142 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:38:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:38:46.079 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:38:46.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T07:38:46.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T07:38:46.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T07:38:46.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T07:38:46.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T07:38:46.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T07:38:46.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T07:38:46.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T07:38:46.081 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T07:38:46.082 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T07:38:46.083 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T07:38:46.084 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T07:38:46.085 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T07:38:46.086 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T07:38:46.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T07:38:46.088 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T07:38:46.089 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T07:38:46.090 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T07:38:46.091 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T07:38:46.092 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T07:38:46.092 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T07:38:48.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:38:48.896 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:48.896 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-09-10T07:38:48.896 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T07:38:48.896 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.897 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.898 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T07:38:48.899 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T07:38:48.900 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T07:38:48.901 INFO:teuthology.orchestra.run.smithi159.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T07:38:48.902 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T07:38:48.903 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T07:38:48.903 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T07:38:48.903 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T07:38:48.903 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T07:38:48.903 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.903 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.903 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.903 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T07:38:48.903 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T07:38:48.904 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T07:38:48.905 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.906 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T07:38:48.907 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T07:38:48.908 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T07:38:48.909 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T07:38:48.909 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T07:38:48.909 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:38:48.909 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-10T07:38:49.318 DEBUG:teuthology.parallel:result is None 2024-09-10T07:38:49.690 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T07:38:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T07:38:49.771 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T07:38:49.804 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T07:38:49.831 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T07:38:50.019 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T07:38:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T07:38:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T07:38:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T07:38:50.176 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T07:38:50.495 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:38:50.495 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T07:38:50.495 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T07:38:50.496 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T07:38:50.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T07:38:50.498 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T07:38:50.499 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T07:38:50.500 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T07:38:50.501 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T07:38:50.502 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T07:38:50.503 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T07:38:50.504 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T07:38:50.505 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T07:38:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T07:38:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T07:38:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T07:38:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T07:38:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T07:38:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T07:38:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T07:38:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T07:38:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T07:38:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T07:38:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T07:38:50.753 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:38:50.799 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:38:50.819 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:38:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T07:38:51.720 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T07:38:51.769 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T07:38:51.854 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T07:38:51.890 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T07:38:51.916 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T07:38:51.942 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T07:38:51.942 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:38:52.026 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:38:52.026 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:38:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:38:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T07:38:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:38:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:38:52.337 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:38:52.337 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:38:52.430 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:38:52.495 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:38:53.437 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T07:38:53.443 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T07:38:53.444 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T07:38:53.446 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T07:38:53.447 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T07:38:53.448 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T07:38:53.449 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.450 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.450 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:38:53.450 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T07:38:53.450 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T07:38:53.450 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T07:38:53.450 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T07:38:53.450 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T07:38:53.450 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T07:38:53.450 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T07:38:53.451 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:38:53.451 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-10T07:38:53.849 DEBUG:teuthology.parallel:result is None 2024-09-10T07:38:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:38:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T07:38:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T07:38:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T07:38:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T07:38:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T07:38:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T07:38:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T07:38:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T07:38:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T07:38:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T07:38:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T07:38:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T07:38:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T07:38:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T07:38:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T07:38:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T07:38:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T07:38:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T07:38:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T07:38:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T07:38:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T07:38:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T07:38:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T07:38:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T07:38:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T07:38:58.269 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T07:38:58.269 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T07:38:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T07:38:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T07:38:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T07:38:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T07:38:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T07:38:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T07:38:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T07:38:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T07:39:00.838 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:39:00.838 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:39:00.838 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-09-10T07:39:00.838 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T07:39:00.839 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.840 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T07:39:00.841 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T07:39:00.842 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T07:39:00.843 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T07:39:00.844 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T07:39:00.845 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T07:39:00.846 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T07:39:00.847 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T07:39:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T07:39:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T07:39:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T07:39:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T07:39:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:39:00.851 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-10T07:39:01.322 DEBUG:teuthology.parallel:result is None 2024-09-10T07:39:01.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:39:01.477 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T07:39:01.500 INFO:teuthology.orchestra.run.smithi073.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T07:39:01.500 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T07:39:01.500 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T07:39:01.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:39:01.646 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T07:39:01.672 INFO:teuthology.orchestra.run.smithi102.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T07:39:01.672 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T07:39:01.672 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T07:39:01.674 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:39:01.825 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T07:39:01.851 INFO:teuthology.orchestra.run.smithi159.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T07:39:01.852 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T07:39:01.852 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T07:39:01.854 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T07:39:01.854 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:39:01.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T07:39:01.881 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:39:01.881 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T07:39:01.914 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:39:01.914 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T07:39:01.946 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T07:39:01.946 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:39:01.948 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T07:39:01.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T07:39:02.037 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:39:02.037 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T07:39:02.067 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T07:39:02.137 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:39:02.137 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T07:39:02.167 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T07:39:02.236 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T07:39:02.236 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:39:02.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T07:39:02.261 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T07:39:02.325 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:39:02.326 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T07:39:02.355 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T07:39:02.422 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:39:02.423 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T07:39:02.448 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T07:39:02.514 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T07:39:02.514 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:39:02.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T07:39:02.539 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T07:39:02.604 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:39:02.604 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T07:39:02.631 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T07:39:02.697 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:39:02.697 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T07:39:02.722 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T07:39:02.788 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T07:39:02.883 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'SLOW_OPS', 'slow request'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-10T07:39:02.883 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:39:02.884 INFO:tasks.cephadm:Cluster fsid is c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:39:02.884 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T07:39:02.884 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.73', 'mon.b': '172.21.15.102', 'mon.c': '172.21.15.159'} 2024-09-10T07:39:02.885 INFO:tasks.cephadm:First mon is mon.a on smithi073 2024-09-10T07:39:02.885 INFO:tasks.cephadm:First mgr is x 2024-09-10T07:39:02.885 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T07:39:02.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname $(hostname -s) 2024-09-10T07:39:02.910 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname $(hostname -s) 2024-09-10T07:39:02.937 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname $(hostname -s) 2024-09-10T07:39:02.963 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T07:39:02.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:39:03.106 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82914/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:14:38.445020', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82912/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:05:03.996701', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-10T07:39:03.243 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240909.165402-squid, sha1 1cf819b7212a6048e92fc78c4eff963344f6d56b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:39:03.244 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T07:39:03.244 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T07:39:03.245 DEBUG:teuthology.orchestra.run.smithi073:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T07:39:03.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 07:39 /home/ubuntu/cephtest/cephadm 2024-09-10T07:39:03.677 DEBUG:teuthology.orchestra.run.smithi102:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T07:39:04.113 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 07:39 /home/ubuntu/cephtest/cephadm 2024-09-10T07:39:04.114 DEBUG:teuthology.orchestra.run.smithi159:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T07:39:04.491 INFO:teuthology.orchestra.run.smithi159.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 07:39 /home/ubuntu/cephtest/cephadm 2024-09-10T07:39:04.491 DEBUG:teuthology.orchestra.run.smithi073:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T07:39:04.511 DEBUG:teuthology.orchestra.run.smithi102:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T07:39:04.531 DEBUG:teuthology.orchestra.run.smithi159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T07:39:04.564 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b on all hosts... 2024-09-10T07:39:04.564 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T07:39:04.567 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T07:39:04.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T07:39:06.178 INFO:teuthology.orchestra.run.smithi159.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:39:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:39:06.310 INFO:teuthology.orchestra.run.smithi073.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:39:32.699 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T07:39:32.700 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T07:39:32.700 INFO:teuthology.orchestra.run.smithi073.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T07:39:32.700 INFO:teuthology.orchestra.run.smithi073.stdout: "repo_digests": [ 2024-09-10T07:39:32.700 INFO:teuthology.orchestra.run.smithi073.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T07:39:32.700 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:39:32.700 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T07:39:33.377 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T07:39:33.377 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T07:39:33.377 INFO:teuthology.orchestra.run.smithi159.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T07:39:33.377 INFO:teuthology.orchestra.run.smithi159.stdout: "repo_digests": [ 2024-09-10T07:39:33.377 INFO:teuthology.orchestra.run.smithi159.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T07:39:33.377 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T07:39:33.378 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T07:39:37.994 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-10T07:39:37.994 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T07:39:37.994 INFO:teuthology.orchestra.run.smithi102.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T07:39:37.994 INFO:teuthology.orchestra.run.smithi102.stdout: "repo_digests": [ 2024-09-10T07:39:37.994 INFO:teuthology.orchestra.run.smithi102.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T07:39:37.995 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-10T07:39:37.995 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-10T07:39:38.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph 2024-09-10T07:39:38.053 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph 2024-09-10T07:39:38.163 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph 2024-09-10T07:39:38.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /etc/ceph 2024-09-10T07:39:38.229 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /etc/ceph 2024-09-10T07:39:38.253 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /etc/ceph 2024-09-10T07:39:38.283 INFO:tasks.cephadm:Writing seed config... 2024-09-10T07:39:38.284 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-10T07:39:38.284 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-10T07:39:38.284 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-10T07:39:38.284 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-10T07:39:38.284 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-10T07:39:38.284 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T07:39:38.284 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-10T07:39:38.285 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-10T07:39:38.286 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-10T07:39:38.287 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T07:39:38.288 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T07:39:38.288 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:39:38.288 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T07:39:38.306 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c025e280-6f47-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-10T07:39:38.307 DEBUG:teuthology.orchestra.run.smithi073:mon.a> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T07:39:38.349 DEBUG:teuthology.orchestra.run.smithi073:mgr.x> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T07:39:38.392 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T07:39:38.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b -v bootstrap --fsid c025e280-6f47-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.73 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T07:39:38.596 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:39:38.596 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b', '-v', 'bootstrap', '--fsid', 'c025e280-6f47-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.73', '--skip-admin-label'] 2024-09-10T07:39:38.597 INFO:teuthology.orchestra.run.smithi073.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T07:39:38.597 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying podman|docker is present... 2024-09-10T07:39:38.620 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 5.2.2 2024-09-10T07:39:38.621 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying lvm2 is present... 2024-09-10T07:39:38.621 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying time synchronization is in place... 2024-09-10T07:39:38.628 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T07:39:38.628 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T07:39:38.634 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T07:39:38.634 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-10T07:39:38.641 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout enabled 2024-09-10T07:39:38.647 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout active 2024-09-10T07:39:38.647 INFO:teuthology.orchestra.run.smithi073.stdout:Unit chronyd.service is enabled and running 2024-09-10T07:39:38.647 INFO:teuthology.orchestra.run.smithi073.stdout:Repeating the final host check... 2024-09-10T07:39:38.670 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 5.2.2 2024-09-10T07:39:38.670 INFO:teuthology.orchestra.run.smithi073.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T07:39:38.671 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl is present 2024-09-10T07:39:38.671 INFO:teuthology.orchestra.run.smithi073.stdout:lvcreate is present 2024-09-10T07:39:38.677 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T07:39:38.677 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T07:39:38.683 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T07:39:38.684 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-10T07:39:38.690 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout enabled 2024-09-10T07:39:38.697 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout active 2024-09-10T07:39:38.697 INFO:teuthology.orchestra.run.smithi073.stdout:Unit chronyd.service is enabled and running 2024-09-10T07:39:38.697 INFO:teuthology.orchestra.run.smithi073.stdout:Host looks OK 2024-09-10T07:39:38.697 INFO:teuthology.orchestra.run.smithi073.stdout:Cluster fsid: c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:39:38.697 INFO:teuthology.orchestra.run.smithi073.stdout:Acquiring lock 139645971702784 on /run/cephadm/c025e280-6f47-11ef-bcea-c7b262605968.lock 2024-09-10T07:39:38.697 INFO:teuthology.orchestra.run.smithi073.stdout:Lock 139645971702784 acquired on /run/cephadm/c025e280-6f47-11ef-bcea-c7b262605968.lock 2024-09-10T07:39:38.697 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying IP 172.21.15.73 port 3300 ... 2024-09-10T07:39:38.698 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying IP 172.21.15.73 port 6789 ... 2024-09-10T07:39:38.698 INFO:teuthology.orchestra.run.smithi073.stdout:Base mon IP(s) is [172.21.15.73:3300, 172.21.15.73:6789], mon addrv is [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2024-09-10T07:39:38.701 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.73 metric 100 2024-09-10T07:39:38.701 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.73 metric 100 2024-09-10T07:39:38.703 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T07:39:38.703 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-10T07:39:38.703 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-10T07:39:38.706 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T07:39:38.706 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T07:39:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T07:39:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-10T07:39:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link noprefixroute 2024-09-10T07:39:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T07:39:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:Mon IP `172.21.15.73` is in CIDR network `172.21.0.0/20` 2024-09-10T07:39:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:Mon IP `172.21.15.73` is in CIDR network `172.21.0.0/20` 2024-09-10T07:39:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T07:39:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T07:39:38.708 INFO:teuthology.orchestra.run.smithi073.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T07:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T07:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying blob sha256:3965ca83761b6e221cd35b61f2ebac0e3b1f9d68a1ce39c1ada69153a1d73116 2024-09-10T07:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T07:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying config sha256:41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T07:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T07:39:50.778 INFO:teuthology.orchestra.run.smithi073.stdout:ceph: stdout ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T07:39:50.778 INFO:teuthology.orchestra.run.smithi073.stdout:Ceph version: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T07:39:50.778 INFO:teuthology.orchestra.run.smithi073.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T07:39:52.812 INFO:teuthology.orchestra.run.smithi073.stdout:stat: stdout 167 167 2024-09-10T07:39:52.812 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial keys... 2024-09-10T07:39:53.698 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQDJ999ms2yWCBAA2CAU2wCSoxsTAIuPt07RLQ== 2024-09-10T07:39:54.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQDK999mE4Z4CRAAkw+dW0ACQbtSvIFRhjF7kA== 2024-09-10T07:39:55.702 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQDL999meezRABAAX8q7hkWY3l082tkzeLawzg== 2024-09-10T07:39:55.703 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial monmap... 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool for a [v2:172.21.15.73:3300,v1:172.21.15.73:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: set fsid to c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:39:56.868 INFO:teuthology.orchestra.run.smithi073.stdout:Creating mon... 2024-09-10T07:39:58.455 INFO:teuthology.orchestra.run.smithi073.stdout:create mon.a on 2024-09-10T07:39:58.674 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T07:39:58.814 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T07:39:58.991 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c025e280-6f47-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c025e280-6f47-11ef-bcea-c7b262605968.target. 2024-09-10T07:39:58.991 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c025e280-6f47-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c025e280-6f47-11ef-bcea-c7b262605968.target. 2024-09-10T07:39:59.224 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.a 2024-09-10T07:39:59.225 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T07:39:59.385 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c025e280-6f47-11ef-bcea-c7b262605968.target.wants/ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c025e280-6f47-11ef-bcea-c7b262605968@.service. 2024-09-10T07:39:59.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:39:59 smithi073 podman[30461]: 2024-09-10 07:39:59.827155916 +0000 UTC m=+0.322671062 container start e8e8034e2c355e75e8c5db5277e6b875a4fd57dc0f136a54e81cbe7caa072eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T07:39:59.946 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T07:39:59.946 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-09-10T07:39:59.953 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T07:39:59.953 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-10T07:39:59.953 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-09-10T07:39:59.953 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T07:39:59.954 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mon to start... 2024-09-10T07:39:59.954 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mon... 2024-09-10T07:40:00.169 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:39:59 smithi073 ceph-mon[30480]: mkfs c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:00.170 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:39:59 smithi073 ceph-mon[30480]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T07:40:00.170 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:39:59 smithi073 bash[30461]: e8e8034e2c355e75e8c5db5277e6b875a4fd57dc0f136a54e81cbe7caa072eb5 2024-09-10T07:40:00.170 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:39:59 smithi073 systemd[1]: Started Ceph mon.a for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:40:00.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T07:40:00.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout id: c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:00.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T07:40:00.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:00.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout services: 2024-09-10T07:40:00.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.553028s) 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout data: 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.345+0000 7f1aa128d640 1 Processor -- start 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.345+0000 7f1aa128d640 1 -- start start 2024-09-10T07:40:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.345+0000 7f1aa128d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c10a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.345+0000 7f1aa128d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c07be90 con 0x7f1a9c1082c0 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.346+0000 7f1a9affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c10a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.346+0000 7f1a9affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c10a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60108/0 (socket says 172.21.15.73:60108) 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.346+0000 7f1a9affd640 1 -- 172.21.15.73:0/4225405877 learned_addr learned my addr 172.21.15.73:0/4225405877 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.346+0000 7f1a9affd640 1 -- 172.21.15.73:0/4225405877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c10abf0 con 0x7f1a9c1082c0 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.348+0000 7f1a9affd640 1 --2- 172.21.15.73:0/4225405877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c10a6b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009e80 tx=0x7f1a8c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cd0f5b50229d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.348+0000 7f1a99ffb640 1 -- 172.21.15.73:0/4225405877 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c036070 con 0x7f1a9c1082c0 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.348+0000 7f1a99ffb640 1 -- 172.21.15.73:0/4225405877 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c031400 con 0x7f1a9c1082c0 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.348+0000 7f1a99ffb640 1 -- 172.21.15.73:0/4225405877 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c031700 con 0x7f1a9c1082c0 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.349+0000 7f1aa128d640 1 -- 172.21.15.73:0/4225405877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 msgr2=0x7f1a9c10a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.349+0000 7f1aa128d640 1 --2- 172.21.15.73:0/4225405877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c10a6b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009e80 tx=0x7f1a8c02a7a0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.349+0000 7f1aa128d640 1 -- 172.21.15.73:0/4225405877 shutdown_connections 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.349+0000 7f1aa128d640 1 --2- 172.21.15.73:0/4225405877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c10a6b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.349+0000 7f1aa128d640 1 -- 172.21.15.73:0/4225405877 >> 172.21.15.73:0/4225405877 conn(0x7f1a9c101e80 msgr2=0x7f1a9c1042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.349+0000 7f1aa128d640 1 -- 172.21.15.73:0/4225405877 shutdown_connections 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.349+0000 7f1aa128d640 1 -- 172.21.15.73:0/4225405877 wait complete. 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.349+0000 7f1aa128d640 1 Processor -- start 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1aa128d640 1 -- start start 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1aa128d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c19b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1aa128d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c10b0d0 con 0x7f1a9c1082c0 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1a9affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c19b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1a9affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c19b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60116/0 (socket says 172.21.15.73:60116) 2024-09-10T07:40:00.994 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1a9affd640 1 -- 172.21.15.73:0/1683011704 learned_addr learned my addr 172.21.15.73:0/1683011704 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1a9affd640 1 -- 172.21.15.73:0/1683011704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c19b540 con 0x7f1a9c1082c0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1a9affd640 1 --2- 172.21.15.73:0/1683011704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c19b000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c034040 tx=0x7f1a8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1a93fff640 1 -- 172.21.15.73:0/1683011704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c041070 con 0x7f1a9c1082c0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1a93fff640 1 -- 172.21.15.73:0/1683011704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c03c650 con 0x7f1a9c1082c0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1a93fff640 1 -- 172.21.15.73:0/1683011704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a8c036040 con 0x7f1a9c1082c0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.350+0000 7f1aa128d640 1 -- 172.21.15.73:0/1683011704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9c19b7d0 con 0x7f1a9c1082c0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.351+0000 7f1aa128d640 1 -- 172.21.15.73:0/1683011704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9c19e4c0 con 0x7f1a9c1082c0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.351+0000 7f1a93fff640 1 -- 172.21.15.73:0/1683011704 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1a8c044070 con 0x7f1a9c1082c0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.351+0000 7f1a93fff640 1 -- 172.21.15.73:0/1683011704 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1a8c046c10 con 0x7f1a9c1082c0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.351+0000 7f1aa128d640 1 -- 172.21.15.73:0/1683011704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a9c108720 con 0x7f1a9c1082c0 2024-09-10T07:40:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.354+0000 7f1a93fff640 1 -- 172.21.15.73:0/1683011704 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1a8c03c950 con 0x7f1a9c1082c0 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.413+0000 7f1aa128d640 1 -- 172.21.15.73:0/1683011704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f1a9c02d980 con 0x7f1a9c1082c0 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.413+0000 7f1a93fff640 1 -- 172.21.15.73:0/1683011704 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f1a8c03cb30 con 0x7f1a9c1082c0 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.414+0000 7f1aa128d640 1 -- 172.21.15.73:0/1683011704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 msgr2=0x7f1a9c19b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.414+0000 7f1aa128d640 1 --2- 172.21.15.73:0/1683011704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c19b000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c034040 tx=0x7f1a8c004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.414+0000 7f1aa128d640 1 -- 172.21.15.73:0/1683011704 shutdown_connections 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.414+0000 7f1aa128d640 1 --2- 172.21.15.73:0/1683011704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a9c1082c0 0x7f1a9c19b000 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.414+0000 7f1aa128d640 1 -- 172.21.15.73:0/1683011704 >> 172.21.15.73:0/1683011704 conn(0x7f1a9c101e80 msgr2=0x7f1a9c102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.414+0000 7f1aa128d640 1 -- 172.21.15.73:0/1683011704 shutdown_connections 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:00.414+0000 7f1aa128d640 1 -- 172.21.15.73:0/1683011704 wait complete. 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:mon is available 2024-09-10T07:40:00.996 INFO:teuthology.orchestra.run.smithi073.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: monmap epoch 1 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: last_changed 2024-09-10T07:39:56.034674+0000 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: min_mon_release 19 (squid) 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: election_strategy: 1 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: fsmap 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T07:40:01.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: mgrmap e1: no daemons active 2024-09-10T07:40:01.100 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:00 smithi073 ceph-mon[30480]: from='client.? 172.21.15.73:0/1683011704' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T07:40:02.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:01 smithi073 ceph-mon[30480]: from='client.? 172.21.15.73:0/4002442528' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T07:40:02.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:01 smithi073 ceph-mon[30480]: from='client.? 172.21.15.73:0/4002442528' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T07:40:02.472 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:02.472 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T07:40:02.472 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout fsid = c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T07:40:02.473 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.369+0000 7f34a9cb7640 1 Processor -- start 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.369+0000 7f34a9cb7640 1 -- start start 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.369+0000 7f34a9cb7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a4106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.369+0000 7f34a9cb7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41070e0 con 0x7f34a4106710 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.369+0000 7f34a37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a4106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.370+0000 7f34a37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a4106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60126/0 (socket says 172.21.15.73:60126) 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.370+0000 7f34a37fe640 1 -- 172.21.15.73:0/1845850924 learned_addr learned my addr 172.21.15.73:0/1845850924 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.370+0000 7f34a37fe640 1 -- 172.21.15.73:0/1845850924 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a4107910 con 0x7f34a4106710 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a37fe640 1 --2- 172.21.15.73:0/1845850924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a4106b10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3494009820 tx=0x7f349402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc57c0e8591891af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a27fc640 1 -- 172.21.15.73:0/1845850924 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3494037070 con 0x7f34a4106710 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a27fc640 1 -- 172.21.15.73:0/1845850924 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3494032440 con 0x7f34a4106710 2024-09-10T07:40:02.474 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a27fc640 1 -- 172.21.15.73:0/1845850924 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3494032740 con 0x7f34a4106710 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a9cb7640 1 -- 172.21.15.73:0/1845850924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 msgr2=0x7f34a4106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a9cb7640 1 --2- 172.21.15.73:0/1845850924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a4106b10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3494009820 tx=0x7f349402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a9cb7640 1 -- 172.21.15.73:0/1845850924 shutdown_connections 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a9cb7640 1 --2- 172.21.15.73:0/1845850924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a4106b10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a9cb7640 1 -- 172.21.15.73:0/1845850924 >> 172.21.15.73:0/1845850924 conn(0x7f34a4101e80 msgr2=0x7f34a41042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a9cb7640 1 -- 172.21.15.73:0/1845850924 shutdown_connections 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.371+0000 7f34a9cb7640 1 -- 172.21.15.73:0/1845850924 wait complete. 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.372+0000 7f34a9cb7640 1 Processor -- start 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.372+0000 7f34a9cb7640 1 -- start start 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.372+0000 7f34a9cb7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a407ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.372+0000 7f34a9cb7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4107eb0 con 0x7f34a4106710 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.372+0000 7f34a37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a407ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.372+0000 7f34a37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a407ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60134/0 (socket says 172.21.15.73:60134) 2024-09-10T07:40:02.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.372+0000 7f34a37fe640 1 -- 172.21.15.73:0/4002442528 learned_addr learned my addr 172.21.15.73:0/4002442528 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.373+0000 7f34a37fe640 1 -- 172.21.15.73:0/4002442528 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a419bb40 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.373+0000 7f34a37fe640 1 --2- 172.21.15.73:0/4002442528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a407ba70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f34940090b0 tx=0x7f34940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.373+0000 7f34a0ff9640 1 -- 172.21.15.73:0/4002442528 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3494041070 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.373+0000 7f34a0ff9640 1 -- 172.21.15.73:0/4002442528 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f349403c7a0 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.373+0000 7f34a9cb7640 1 -- 172.21.15.73:0/4002442528 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a41a0150 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.373+0000 7f34a0ff9640 1 -- 172.21.15.73:0/4002442528 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3494037040 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.373+0000 7f34a9cb7640 1 -- 172.21.15.73:0/4002442528 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a41a04f0 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.373+0000 7f34a0ff9640 1 -- 172.21.15.73:0/4002442528 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3494044070 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.373+0000 7f34a0ff9640 1 -- 172.21.15.73:0/4002442528 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f349403d3f0 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.374+0000 7f34a9cb7640 1 -- 172.21.15.73:0/4002442528 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a4108500 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.376+0000 7f34a0ff9640 1 -- 172.21.15.73:0/4002442528 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3494046450 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.432+0000 7f34a9cb7640 1 -- 172.21.15.73:0/4002442528 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f34a41a0830 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.435+0000 7f34a0ff9640 1 -- 172.21.15.73:0/4002442528 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+454 (secure 0 0 0) 0x7f3494046630 con 0x7f34a4106710 2024-09-10T07:40:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.436+0000 7f34a0ff9640 1 -- 172.21.15.73:0/4002442528 <== mon.0 v2:172.21.15.73:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3494056070 con 0x7f34a4106710 2024-09-10T07:40:02.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.437+0000 7f34a9cb7640 1 -- 172.21.15.73:0/4002442528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 msgr2=0x7f34a407ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:02.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.437+0000 7f34a9cb7640 1 --2- 172.21.15.73:0/4002442528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a407ba70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f34940090b0 tx=0x7f34940046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.437+0000 7f34a9cb7640 1 -- 172.21.15.73:0/4002442528 shutdown_connections 2024-09-10T07:40:02.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.437+0000 7f34a9cb7640 1 --2- 172.21.15.73:0/4002442528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34a4106710 0x7f34a407ba70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.437+0000 7f34a9cb7640 1 -- 172.21.15.73:0/4002442528 >> 172.21.15.73:0/4002442528 conn(0x7f34a4101e80 msgr2=0x7f34a418e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:02.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.437+0000 7f34a9cb7640 1 -- 172.21.15.73:0/4002442528 shutdown_connections 2024-09-10T07:40:02.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:01.437+0000 7f34a9cb7640 1 -- 172.21.15.73:0/4002442528 wait complete. 2024-09-10T07:40:02.477 INFO:teuthology.orchestra.run.smithi073.stdout:Generating new minimal ceph.conf... 2024-09-10T07:40:03.144 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:02 smithi073 ceph-mon[30480]: from='client.? 172.21.15.73:0/3763287537' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:40:03.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.843+0000 7fdb18e3f640 1 Processor -- start 2024-09-10T07:40:03.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.843+0000 7fdb18e3f640 1 -- start start 2024-09-10T07:40:03.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.843+0000 7fdb18e3f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14106b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.843+0000 7fdb18e3f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14107110 con 0x7fdb14106740 2024-09-10T07:40:03.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.843+0000 7fdb1259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14106b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.843+0000 7fdb1259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14106b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60142/0 (socket says 172.21.15.73:60142) 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.843+0000 7fdb1259c640 1 -- 172.21.15.73:0/762686227 learned_addr learned my addr 172.21.15.73:0/762686227 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.843+0000 7fdb1259c640 1 -- 172.21.15.73:0/762686227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb14107940 con 0x7fdb14106740 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.844+0000 7fdb1259c640 1 --2- 172.21.15.73:0/762686227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14106b40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009820 tx=0x7fdb0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a14af97dfd648d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.844+0000 7fdb1159a640 1 -- 172.21.15.73:0/762686227 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04037070 con 0x7fdb14106740 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.844+0000 7fdb1159a640 1 -- 172.21.15.73:0/762686227 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb04032900 con 0x7fdb14106740 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.844+0000 7fdb1159a640 1 -- 172.21.15.73:0/762686227 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04030850 con 0x7fdb14106740 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.845+0000 7fdb18e3f640 1 -- 172.21.15.73:0/762686227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 msgr2=0x7fdb14106b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.845+0000 7fdb18e3f640 1 --2- 172.21.15.73:0/762686227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14106b40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009820 tx=0x7fdb0402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.845+0000 7fdb18e3f640 1 -- 172.21.15.73:0/762686227 shutdown_connections 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.845+0000 7fdb18e3f640 1 --2- 172.21.15.73:0/762686227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14106b40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.845+0000 7fdb18e3f640 1 -- 172.21.15.73:0/762686227 >> 172.21.15.73:0/762686227 conn(0x7fdb14101ed0 msgr2=0x7fdb14104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.845+0000 7fdb18e3f640 1 -- 172.21.15.73:0/762686227 shutdown_connections 2024-09-10T07:40:03.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.845+0000 7fdb18e3f640 1 -- 172.21.15.73:0/762686227 wait complete. 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.846+0000 7fdb18e3f640 1 Processor -- start 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.846+0000 7fdb18e3f640 1 -- start start 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.846+0000 7fdb18e3f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14191970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.846+0000 7fdb18e3f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1410acf0 con 0x7fdb14106740 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.846+0000 7fdb1259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14191970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.846+0000 7fdb1259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14191970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60150/0 (socket says 172.21.15.73:60150) 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.846+0000 7fdb1259c640 1 -- 172.21.15.73:0/3763287537 learned_addr learned my addr 172.21.15.73:0/3763287537 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.846+0000 7fdb1259c640 1 -- 172.21.15.73:0/3763287537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb14191eb0 con 0x7fdb14106740 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.846+0000 7fdb1259c640 1 --2- 172.21.15.73:0/3763287537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14191970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009940 tx=0x7fdb040326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.847+0000 7fdb037fe640 1 -- 172.21.15.73:0/3763287537 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04042070 con 0x7fdb14106740 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.847+0000 7fdb037fe640 1 -- 172.21.15.73:0/3763287537 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb04032be0 con 0x7fdb14106740 2024-09-10T07:40:03.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.847+0000 7fdb037fe640 1 -- 172.21.15.73:0/3763287537 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04037040 con 0x7fdb14106740 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.847+0000 7fdb18e3f640 1 -- 172.21.15.73:0/3763287537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb141900a0 con 0x7fdb14106740 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.847+0000 7fdb18e3f640 1 -- 172.21.15.73:0/3763287537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb141905e0 con 0x7fdb14106740 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.847+0000 7fdb037fe640 1 -- 172.21.15.73:0/3763287537 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb04045070 con 0x7fdb14106740 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.847+0000 7fdb037fe640 1 -- 172.21.15.73:0/3763287537 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb040479f0 con 0x7fdb14106740 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.848+0000 7fdb18e3f640 1 -- 172.21.15.73:0/3763287537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1410ae70 con 0x7fdb14106740 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.850+0000 7fdb037fe640 1 -- 172.21.15.73:0/3763287537 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdb04032d90 con 0x7fdb14106740 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.907+0000 7fdb18e3f640 1 -- 172.21.15.73:0/3763287537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fdb14195280 con 0x7fdb14106740 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.907+0000 7fdb037fe640 1 -- 172.21.15.73:0/3763287537 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fdb0403d430 con 0x7fdb14106740 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.908+0000 7fdb18e3f640 1 -- 172.21.15.73:0/3763287537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 msgr2=0x7fdb14191970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.908+0000 7fdb18e3f640 1 --2- 172.21.15.73:0/3763287537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14191970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009940 tx=0x7fdb040326e0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.908+0000 7fdb18e3f640 1 -- 172.21.15.73:0/3763287537 shutdown_connections 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.908+0000 7fdb18e3f640 1 --2- 172.21.15.73:0/3763287537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb14106740 0x7fdb14191970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.908+0000 7fdb18e3f640 1 -- 172.21.15.73:0/3763287537 >> 172.21.15.73:0/3763287537 conn(0x7fdb14101ed0 msgr2=0x7fdb14102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:03.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.908+0000 7fdb18e3f640 1 -- 172.21.15.73:0/3763287537 shutdown_connections 2024-09-10T07:40:03.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:02.908+0000 7fdb18e3f640 1 -- 172.21.15.73:0/3763287537 wait complete. 2024-09-10T07:40:03.481 INFO:teuthology.orchestra.run.smithi073.stdout:Restarting the monitor... 2024-09-10T07:40:03.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:03 smithi073 systemd[1]: Stopping Ceph mon.a for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:40:04.116 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a[30476]: 2024-09-10T07:40:03.799+0000 7f812d6ee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T07:40:04.116 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a[30476]: 2024-09-10T07:40:03.799+0000 7f812d6ee640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T07:40:04.116 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:03 smithi073 podman[30725]: 2024-09-10 07:40:03.83067336 +0000 UTC m=+0.189848940 container died e8e8034e2c355e75e8c5db5277e6b875a4fd57dc0f136a54e81cbe7caa072eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T07:40:04.416 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 podman[30725]: 2024-09-10 07:40:04.208149143 +0000 UTC m=+0.567324720 container cleanup e8e8034e2c355e75e8c5db5277e6b875a4fd57dc0f136a54e81cbe7caa072eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T07:40:04.416 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 bash[30725]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a 2024-09-10T07:40:04.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 podman[30737]: 2024-09-10 07:40:04.417535163 +0000 UTC m=+0.579105562 container remove e8e8034e2c355e75e8c5db5277e6b875a4fd57dc0f136a54e81cbe7caa072eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T07:40:04.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T07:40:04.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 systemd[1]: Stopped Ceph mon.a for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:40:04.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 systemd[1]: Starting Ceph mon.a for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:40:05.002 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 podman[30831]: 2024-09-10 07:40:04.655214298 +0000 UTC m=+0.015895383 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:40:05.002 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 podman[30831]: 2024-09-10 07:40:04.760048584 +0000 UTC m=+0.120729653 container create ef87ed974fd010627cdb48ed588e1eb9de4385a0d3c4454b90c13121e1dae6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T07:40:05.002 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 podman[30831]: 2024-09-10 07:40:04.979191952 +0000 UTC m=+0.339873023 container init ef87ed974fd010627cdb48ed588e1eb9de4385a0d3c4454b90c13121e1dae6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T07:40:05.002 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:04 smithi073 podman[30831]: 2024-09-10 07:40:04.982235907 +0000 UTC m=+0.342916987 container start ef87ed974fd010627cdb48ed588e1eb9de4385a0d3c4454b90c13121e1dae6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T07:40:05.099 INFO:teuthology.orchestra.run.smithi073.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T07:40:05.302 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T07:40:05.302 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T07:40:05.302 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: pidfile_write: ignore empty --pid-file 2024-09-10T07:40:05.302 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: load: jerasure load: lrc 2024-09-10T07:40:05.302 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: RocksDB version: 7.9.2 2024-09-10T07:40:05.302 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Git sha 0 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: DB SUMMARY 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: DB Session ID: 9K9K7RE3WKI07S51X4FB 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: CURRENT file: CURRENT 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106496 ; 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.error_if_exists: 0 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.create_if_missing: 0 2024-09-10T07:40:05.303 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.paranoid_checks: 1 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.env: 0x55d55eeb4940 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.info_log: 0x55d55fdf76e0 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.statistics: (nil) 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.use_fsync: 0 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_log_file_size: 0 2024-09-10T07:40:05.304 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.allow_fallocate: 1 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.use_direct_reads: 0 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.db_log_dir: 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.wal_dir: 2024-09-10T07:40:05.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.write_buffer_manager: 0x55d55fe06dc0 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T07:40:05.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.unordered_write: 0 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.row_cache: None 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.wal_filter: None 2024-09-10T07:40:05.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.two_write_queues: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.wal_compression: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.atomic_flush: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.log_readahead_size: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T07:40:05.309 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T07:40:05.310 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T07:40:05.310 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T07:40:05.310 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T07:40:05.310 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T07:40:05.310 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_background_jobs: 2 2024-09-10T07:40:05.310 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_background_compactions: -1 2024-09-10T07:40:05.310 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_subcompactions: 1 2024-09-10T07:40:05.310 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T07:40:05.310 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_open_files: -1 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T07:40:05.311 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_background_flushes: -1 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Compression algorithms supported: 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: kZSTD supported: 0 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: kXpressCompression supported: 0 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: kBZip2Compression supported: 0 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: kLZ4Compression supported: 1 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: kZlibCompression supported: 1 2024-09-10T07:40:05.312 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: kSnappyCompression supported: 1 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.merge_operator: 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_filter: None 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T07:40:05.313 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T07:40:05.314 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T07:40:05.314 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T07:40:05.314 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d55fdf7320) 2024-09-10T07:40:05.314 INFO:journalctl@ceph.mon.a.smithi073.stdout: cache_index_and_filter_blocks: 1 2024-09-10T07:40:05.314 INFO:journalctl@ceph.mon.a.smithi073.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T07:40:05.314 INFO:journalctl@ceph.mon.a.smithi073.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T07:40:05.314 INFO:journalctl@ceph.mon.a.smithi073.stdout: pin_top_level_index_and_filter: 1 2024-09-10T07:40:05.314 INFO:journalctl@ceph.mon.a.smithi073.stdout: index_type: 0 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: data_block_index_type: 0 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: index_shortening: 1 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: checksum: 4 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: no_block_cache: 0 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache: 0x55d55fdeb1f0 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache_name: BinnedLRUCache 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache_options: 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: capacity : 536870912 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: num_shard_bits : 4 2024-09-10T07:40:05.315 INFO:journalctl@ceph.mon.a.smithi073.stdout: strict_capacity_limit : 0 2024-09-10T07:40:05.316 INFO:journalctl@ceph.mon.a.smithi073.stdout: high_pri_pool_ratio: 0.000 2024-09-10T07:40:05.316 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache_compressed: (nil) 2024-09-10T07:40:05.316 INFO:journalctl@ceph.mon.a.smithi073.stdout: persistent_cache: (nil) 2024-09-10T07:40:05.316 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_size: 4096 2024-09-10T07:40:05.316 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_size_deviation: 10 2024-09-10T07:40:05.316 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_restart_interval: 16 2024-09-10T07:40:05.316 INFO:journalctl@ceph.mon.a.smithi073.stdout: index_block_restart_interval: 1 2024-09-10T07:40:05.316 INFO:journalctl@ceph.mon.a.smithi073.stdout: metadata_block_size: 4096 2024-09-10T07:40:05.316 INFO:journalctl@ceph.mon.a.smithi073.stdout: partition_filters: 0 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: use_delta_encoding: 1 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: filter_policy: bloomfilter 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: whole_key_filtering: 1 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: verify_compression: 0 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: read_amp_bytes_per_bit: 0 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: format_version: 5 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: enable_index_compression: 1 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_align: 0 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: max_auto_readahead_size: 262144 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: prepopulate_block_cache: 0 2024-09-10T07:40:05.317 INFO:journalctl@ceph.mon.a.smithi073.stdout: initial_auto_readahead_size: 8192 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression: NoCompression 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.num_levels: 7 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T07:40:05.318 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T07:40:05.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T07:40:05.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T07:40:05.321 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.inplace_update_support: 0 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T07:40:05.322 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.bloom_locality: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.max_successive_merges: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.ttl: 2592000 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T07:40:05.323 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.enable_blob_files: false 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.min_blob_size: 0 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bff09de5-652a-4b45-8e09-0bbd03bfbd08 2024-09-10T07:40:05.324 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725954005008393, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725954005009423, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101387, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99272, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14625, "raw_average_key_size": 49, "raw_value_size": 91416, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725954005, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bff09de5-652a-4b45-8e09-0bbd03bfbd08", "db_session_id": "9K9K7RE3WKI07S51X4FB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725954005009491, "job": 1, "event": "recovery_finished"} 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d55fe18e00 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: DB pointer 0x55d55ff14000 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** DB Stats ** 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T07:40:05.325 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** Compaction Stats [default] ** 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: L0 2/0 100.87 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: Sum 2/0 100.87 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** Compaction Stats [default] ** 2024-09-10T07:40:05.326 INFO:journalctl@ceph.mon.a.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 144.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative compaction: 0.00 GB write, 30.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T07:40:05.327 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval compaction: 0.00 GB write, 30.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout: Block cache BinnedLRUCache@0x55d55fdeb1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: starting mon.a rank 0 at public addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] at bind addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mon.a@-1(???) e1 preinit fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mon.a@-1(???).mds e1 new map 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mon.a@-1(???).mds e1 print_map 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout: e1 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout: btime 2024-09-10T07:39:59:864905+0000 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T07:40:05.328 INFO:journalctl@ceph.mon.a.smithi073.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout: legacy client fscid: -1 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout: No filesystems configured 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: monmap epoch 1 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: last_changed 2024-09-10T07:39:56.034674+0000 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:40:05.329 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: min_mon_release 19 (squid) 2024-09-10T07:40:05.330 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: election_strategy: 1 2024-09-10T07:40:05.330 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:40:05.330 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: fsmap 2024-09-10T07:40:05.330 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T07:40:05.330 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 ceph-mon[30850]: mgrmap e1: no daemons active 2024-09-10T07:40:05.330 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 bash[30831]: ef87ed974fd010627cdb48ed588e1eb9de4385a0d3c4454b90c13121e1dae6da 2024-09-10T07:40:05.330 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:05 smithi073 systemd[1]: Started Ceph mon.a for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:40:06.070 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.478+0000 7f8a510a5640 1 Processor -- start 2024-09-10T07:40:06.075 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.478+0000 7f8a510a5640 1 -- start start 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.478+0000 7f8a510a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c10a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.478+0000 7f8a510a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c07c760 con 0x7f8a4c1082b0 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.478+0000 7f8a4ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c10a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.478+0000 7f8a4ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c10a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60158/0 (socket says 172.21.15.73:60158) 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.478+0000 7f8a4ad9d640 1 -- 172.21.15.73:0/180705234 learned_addr learned my addr 172.21.15.73:0/180705234 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.479+0000 7f8a4ad9d640 1 -- 172.21.15.73:0/180705234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c10abe0 con 0x7f8a4c1082b0 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.480+0000 7f8a4ad9d640 1 --2- 172.21.15.73:0/180705234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c10a6a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009820 tx=0x7f8a3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e0553d7278df7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a49d9b640 1 -- 172.21.15.73:0/180705234 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3c037070 con 0x7f8a4c1082b0 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a49d9b640 1 -- 172.21.15.73:0/180705234 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a3c032900 con 0x7f8a4c1082b0 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a49d9b640 1 -- 172.21.15.73:0/180705234 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3c030850 con 0x7f8a4c1082b0 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a510a5640 1 -- 172.21.15.73:0/180705234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 msgr2=0x7f8a4c10a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a510a5640 1 --2- 172.21.15.73:0/180705234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c10a6a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009820 tx=0x7f8a3c02a270 comp rx=0 tx=0).stop 2024-09-10T07:40:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a510a5640 1 -- 172.21.15.73:0/180705234 shutdown_connections 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a510a5640 1 --2- 172.21.15.73:0/180705234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c10a6a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a510a5640 1 -- 172.21.15.73:0/180705234 >> 172.21.15.73:0/180705234 conn(0x7f8a4c101ed0 msgr2=0x7f8a4c104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a510a5640 1 -- 172.21.15.73:0/180705234 shutdown_connections 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.481+0000 7f8a510a5640 1 -- 172.21.15.73:0/180705234 wait complete. 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.482+0000 7f8a510a5640 1 Processor -- start 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.482+0000 7f8a510a5640 1 -- start start 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.482+0000 7f8a510a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c107b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.482+0000 7f8a510a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c10bc80 con 0x7f8a4c1082b0 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.482+0000 7f8a4ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c107b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.482+0000 7f8a4ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c107b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60166/0 (socket says 172.21.15.73:60166) 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.482+0000 7f8a4ad9d640 1 -- 172.21.15.73:0/812018357 learned_addr learned my addr 172.21.15.73:0/812018357 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.483+0000 7f8a4ad9d640 1 -- 172.21.15.73:0/812018357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c108070 con 0x7f8a4c1082b0 2024-09-10T07:40:06.077 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.483+0000 7f8a4ad9d640 1 --2- 172.21.15.73:0/812018357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c107b30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c031000 tx=0x7f8a3c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.483+0000 7f8a33fff640 1 -- 172.21.15.73:0/812018357 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3c042070 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.483+0000 7f8a510a5640 1 -- 172.21.15.73:0/812018357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c106260 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.483+0000 7f8a33fff640 1 -- 172.21.15.73:0/812018357 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a3c032be0 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.483+0000 7f8a33fff640 1 -- 172.21.15.73:0/812018357 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3c037040 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.483+0000 7f8a510a5640 1 -- 172.21.15.73:0/812018357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c1067a0 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.483+0000 7f8a33fff640 1 -- 172.21.15.73:0/812018357 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a3c045070 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.484+0000 7f8a33fff640 1 -- 172.21.15.73:0/812018357 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a3c047ad0 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.484+0000 7f8a510a5640 1 -- 172.21.15.73:0/812018357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c108710 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.486+0000 7f8a33fff640 1 -- 172.21.15.73:0/812018357 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8a3c04c030 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.543+0000 7f8a510a5640 1 -- 172.21.15.73:0/812018357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f8a4c106ae0 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.547+0000 7f8a33fff640 1 -- 172.21.15.73:0/812018357 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f8a3c0328a0 con 0x7f8a4c1082b0 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.548+0000 7f8a510a5640 1 -- 172.21.15.73:0/812018357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 msgr2=0x7f8a4c107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.548+0000 7f8a510a5640 1 --2- 172.21.15.73:0/812018357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c107b30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c031000 tx=0x7f8a3c0326e0 comp rx=0 tx=0).stop 2024-09-10T07:40:06.079 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.548+0000 7f8a510a5640 1 -- 172.21.15.73:0/812018357 shutdown_connections 2024-09-10T07:40:06.079 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.548+0000 7f8a510a5640 1 --2- 172.21.15.73:0/812018357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a4c1082b0 0x7f8a4c107b30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:06.079 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.548+0000 7f8a510a5640 1 -- 172.21.15.73:0/812018357 >> 172.21.15.73:0/812018357 conn(0x7f8a4c101ed0 msgr2=0x7f8a4c102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:06.079 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.548+0000 7f8a510a5640 1 -- 172.21.15.73:0/812018357 shutdown_connections 2024-09-10T07:40:06.079 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:05.548+0000 7f8a510a5640 1 -- 172.21.15.73:0/812018357 wait complete. 2024-09-10T07:40:06.079 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T07:40:06.093 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T07:40:06.093 INFO:teuthology.orchestra.run.smithi073.stdout:Creating mgr... 2024-09-10T07:40:06.093 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T07:40:06.093 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T07:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.x 2024-09-10T07:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T07:40:06.485 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c025e280-6f47-11ef-bcea-c7b262605968.target.wants/ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c025e280-6f47-11ef-bcea-c7b262605968@.service. 2024-09-10T07:40:06.799 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:06 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/812018357' entity='client.admin' 2024-09-10T07:40:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T07:40:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-09-10T07:40:06.998 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T07:40:06.998 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-10T07:40:06.998 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-09-10T07:40:06.999 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T07:40:07.009 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T07:40:07.009 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-09-10T07:40:07.018 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T07:40:07.018 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-10T07:40:07.018 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-09-10T07:40:07.018 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T07:40:07.018 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr to start... 2024-09-10T07:40:07.018 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr... 2024-09-10T07:40:07.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:07 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4088332614' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T07:40:07.722 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:07.614+0000 7f7dec78e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "c025e280-6f47-11ef-bcea-c7b262605968", 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T07:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T07:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T07:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T07:39:59:864905+0000", 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T07:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T07:39:59.865568+0000", 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T07:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.388+0000 7f280269e640 1 Processor -- start 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.389+0000 7f280269e640 1 -- start start 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.389+0000 7f280269e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc106b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.389+0000 7f280269e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc107160 con 0x7f27fc106790 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.389+0000 7f27fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.389+0000 7f27fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60184/0 (socket says 172.21.15.73:60184) 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.389+0000 7f27fbfff640 1 -- 172.21.15.73:0/1648032012 learned_addr learned my addr 172.21.15.73:0/1648032012 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.389+0000 7f27fbfff640 1 -- 172.21.15.73:0/1648032012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc1078f0 con 0x7f27fc106790 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.390+0000 7f27fbfff640 1 --2- 172.21.15.73:0/1648032012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc106b90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009820 tx=0x7f27ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28365c50f0f4cef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.390+0000 7f27fb7fe640 1 -- 172.21.15.73:0/1648032012 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ec037070 con 0x7f27fc106790 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.390+0000 7f27fb7fe640 1 -- 172.21.15.73:0/1648032012 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27ec032900 con 0x7f27fc106790 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.390+0000 7f27fb7fe640 1 -- 172.21.15.73:0/1648032012 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ec030850 con 0x7f27fc106790 2024-09-10T07:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.391+0000 7f280269e640 1 -- 172.21.15.73:0/1648032012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 msgr2=0x7f27fc106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.391+0000 7f280269e640 1 --2- 172.21.15.73:0/1648032012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc106b90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009820 tx=0x7f27ec02a270 comp rx=0 tx=0).stop 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.391+0000 7f280269e640 1 -- 172.21.15.73:0/1648032012 shutdown_connections 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.391+0000 7f280269e640 1 --2- 172.21.15.73:0/1648032012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc106b90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.391+0000 7f280269e640 1 -- 172.21.15.73:0/1648032012 >> 172.21.15.73:0/1648032012 conn(0x7f27fc101f60 msgr2=0x7f27fc104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.391+0000 7f280269e640 1 -- 172.21.15.73:0/1648032012 shutdown_connections 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.391+0000 7f280269e640 1 -- 172.21.15.73:0/1648032012 wait complete. 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.391+0000 7f280269e640 1 Processor -- start 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f280269e640 1 -- start start 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f280269e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc07c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f280269e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc10aca0 con 0x7f27fc106790 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f27fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc07c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f27fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc07c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60190/0 (socket says 172.21.15.73:60190) 2024-09-10T07:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f27fbfff640 1 -- 172.21.15.73:0/4088332614 learned_addr learned my addr 172.21.15.73:0/4088332614 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f27fbfff640 1 -- 172.21.15.73:0/4088332614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc19e570 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f27fbfff640 1 --2- 172.21.15.73:0/4088332614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc07c290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009940 tx=0x7f27ec032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f27f9ffb640 1 -- 172.21.15.73:0/4088332614 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ec042070 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f27f9ffb640 1 -- 172.21.15.73:0/4088332614 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27ec0308c0 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f280269e640 1 -- 172.21.15.73:0/4088332614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27fc19e740 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f27f9ffb640 1 -- 172.21.15.73:0/4088332614 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ec037040 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.392+0000 7f280269e640 1 -- 172.21.15.73:0/4088332614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27fc19eae0 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.393+0000 7f27f9ffb640 1 -- 172.21.15.73:0/4088332614 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f27ec045070 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.393+0000 7f27f9ffb640 1 -- 172.21.15.73:0/4088332614 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f27ec047bb0 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.393+0000 7f280269e640 1 -- 172.21.15.73:0/4088332614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27fc106c10 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.395+0000 7f27f9ffb640 1 -- 172.21.15.73:0/4088332614 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f27ec0327b0 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.459+0000 7f280269e640 1 -- 172.21.15.73:0/4088332614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f27fc19ef20 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.459+0000 7f27f9ffb640 1 -- 172.21.15.73:0/4088332614 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f27ec03c760 con 0x7f27fc106790 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.460+0000 7f280269e640 1 -- 172.21.15.73:0/4088332614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 msgr2=0x7f27fc07c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.460+0000 7f280269e640 1 --2- 172.21.15.73:0/4088332614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc07c290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009940 tx=0x7f27ec032ce0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.460+0000 7f280269e640 1 -- 172.21.15.73:0/4088332614 shutdown_connections 2024-09-10T07:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.460+0000 7f280269e640 1 --2- 172.21.15.73:0/4088332614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc106790 0x7f27fc07c290 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.460+0000 7f280269e640 1 -- 172.21.15.73:0/4088332614 >> 172.21.15.73:0/4088332614 conn(0x7f27fc101f60 msgr2=0x7f27fc102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.460+0000 7f280269e640 1 -- 172.21.15.73:0/4088332614 shutdown_connections 2024-09-10T07:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:07.460+0000 7f280269e640 1 -- 172.21.15.73:0/4088332614 wait complete. 2024-09-10T07:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout:mgr not available, waiting (1/15)... 2024-09-10T07:40:08.184 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:07.937+0000 7f7dec78e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:40:08.184 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:07.999+0000 7f7dec78e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:40:08.472 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:08.184+0000 7f7dec78e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:40:09.472 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:09.060+0000 7f7dec78e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:40:09.472 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:09.127+0000 7f7dec78e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:40:10.097 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:09.838+0000 7f7dec78e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:40:10.098 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:09.952+0000 7f7dec78e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:40:10.098 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.097+0000 7f7dec78e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:40:10.380 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.159+0000 7f7dec78e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:40:10.380 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.310+0000 7f7dec78e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:40:10.380 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.380+0000 7f7dec78e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:40:10.650 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.441+0000 7f7dec78e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:40:10.650 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.624+0000 7f7dec78e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:40:10.901 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3966184455' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T07:40:10.901 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.692+0000 7f7dec78e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:40:10.902 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.760+0000 7f7dec78e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:40:10.902 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.842+0000 7f7dec78e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:40:10.902 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.901+0000 7f7dec78e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:40:11.217 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:10.961+0000 7f7dec78e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:40:11.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:11.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:40:11.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "c025e280-6f47-11ef-bcea-c7b262605968", 2024-09-10T07:40:11.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T07:40:11.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T07:40:11.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T07:40:11.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:11.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T07:39:59:864905+0000", 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T07:40:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T07:39:59.865568+0000", 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.510+0000 7fb49d1f9640 1 Processor -- start 2024-09-10T07:40:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.510+0000 7fb49d1f9640 1 -- start start 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.511+0000 7fb49d1f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb498106b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.511+0000 7fb49d1f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb498107110 con 0x7fb498106740 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.511+0000 7fb496d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb498106b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.511+0000 7fb496d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb498106b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53340/0 (socket says 172.21.15.73:53340) 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.511+0000 7fb496d9d640 1 -- 172.21.15.73:0/659947274 learned_addr learned my addr 172.21.15.73:0/659947274 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.511+0000 7fb496d9d640 1 -- 172.21.15.73:0/659947274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb498107940 con 0x7fb498106740 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.512+0000 7fb496d9d640 1 --2- 172.21.15.73:0/659947274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb498106b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb488009820 tx=0x7fb48802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7a9744d4d9b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.512+0000 7fb495d9b640 1 -- 172.21.15.73:0/659947274 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb488037070 con 0x7fb498106740 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.512+0000 7fb495d9b640 1 -- 172.21.15.73:0/659947274 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb488032900 con 0x7fb498106740 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.512+0000 7fb495d9b640 1 -- 172.21.15.73:0/659947274 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb488030850 con 0x7fb498106740 2024-09-10T07:40:11.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.512+0000 7fb49d1f9640 1 -- 172.21.15.73:0/659947274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 msgr2=0x7fb498106b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.512+0000 7fb49d1f9640 1 --2- 172.21.15.73:0/659947274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb498106b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb488009820 tx=0x7fb48802a270 comp rx=0 tx=0).stop 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.512+0000 7fb49d1f9640 1 -- 172.21.15.73:0/659947274 shutdown_connections 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.512+0000 7fb49d1f9640 1 --2- 172.21.15.73:0/659947274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb498106b40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.512+0000 7fb49d1f9640 1 -- 172.21.15.73:0/659947274 >> 172.21.15.73:0/659947274 conn(0x7fb498101ed0 msgr2=0x7fb498104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.513+0000 7fb49d1f9640 1 -- 172.21.15.73:0/659947274 shutdown_connections 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.513+0000 7fb49d1f9640 1 -- 172.21.15.73:0/659947274 wait complete. 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.513+0000 7fb49d1f9640 1 Processor -- start 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb49d1f9640 1 -- start start 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb49d1f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb49819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb49d1f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb49810acf0 con 0x7fb498106740 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb496d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb49819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb496d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb49819b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53342/0 (socket says 172.21.15.73:53342) 2024-09-10T07:40:11.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb496d9d640 1 -- 172.21.15.73:0/3966184455 learned_addr learned my addr 172.21.15.73:0/3966184455 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb496d9d640 1 -- 172.21.15.73:0/3966184455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49819bef0 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb496d9d640 1 --2- 172.21.15.73:0/3966184455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb49819b9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb488009940 tx=0x7fb4880326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb47ffff640 1 -- 172.21.15.73:0/3966184455 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb488042070 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb49d1f9640 1 -- 172.21.15.73:0/3966184455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49819c180 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb47ffff640 1 -- 172.21.15.73:0/3966184455 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb488032ca0 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.514+0000 7fb47ffff640 1 -- 172.21.15.73:0/3966184455 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb488037040 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.515+0000 7fb49d1f9640 1 -- 172.21.15.73:0/3966184455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49819ee70 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.515+0000 7fb47ffff640 1 -- 172.21.15.73:0/3966184455 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb488045070 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.515+0000 7fb47ffff640 1 -- 172.21.15.73:0/3966184455 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb488047a40 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.515+0000 7fb49d1f9640 1 -- 172.21.15.73:0/3966184455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb498106bc0 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.517+0000 7fb47ffff640 1 -- 172.21.15.73:0/3966184455 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb48803d9f0 con 0x7fb498106740 2024-09-10T07:40:11.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.599+0000 7fb49d1f9640 1 -- 172.21.15.73:0/3966184455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb498195810 con 0x7fb498106740 2024-09-10T07:40:11.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.600+0000 7fb47ffff640 1 -- 172.21.15.73:0/3966184455 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb48803d430 con 0x7fb498106740 2024-09-10T07:40:11.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.601+0000 7fb49d1f9640 1 -- 172.21.15.73:0/3966184455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 msgr2=0x7fb49819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:11.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.601+0000 7fb49d1f9640 1 --2- 172.21.15.73:0/3966184455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb49819b9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb488009940 tx=0x7fb4880326e0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.601+0000 7fb49d1f9640 1 -- 172.21.15.73:0/3966184455 shutdown_connections 2024-09-10T07:40:11.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.601+0000 7fb49d1f9640 1 --2- 172.21.15.73:0/3966184455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb498106740 0x7fb49819b9b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.601+0000 7fb49d1f9640 1 -- 172.21.15.73:0/3966184455 >> 172.21.15.73:0/3966184455 conn(0x7fb498101ed0 msgr2=0x7fb498102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:11.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.601+0000 7fb49d1f9640 1 -- 172.21.15.73:0/3966184455 shutdown_connections 2024-09-10T07:40:11.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:10.601+0000 7fb49d1f9640 1 -- 172.21.15.73:0/3966184455 wait complete. 2024-09-10T07:40:11.360 INFO:teuthology.orchestra.run.smithi073.stdout:mgr not available, waiting (2/15)... 2024-09-10T07:40:12.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:11.755+0000 7f7dec78e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: Activating manager daemon x 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: mgrmap e2: x(active, starting, since 0.00297692s) 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: Manager daemon x is now available 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' 2024-09-10T07:40:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' 2024-09-10T07:40:12.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:11 smithi073 ceph-mon[30850]: from='mgr.14100 172.21.15.73:0/2525981644' entity='mgr.x' 2024-09-10T07:40:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:13 smithi073 ceph-mon[30850]: mgrmap e3: x(active, since 1.00737s) 2024-09-10T07:40:14.523 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:14.523 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "c025e280-6f47-11ef-bcea-c7b262605968", 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T07:40:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T07:40:14.525 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T07:40:14.534 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T07:40:14.534 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:14.535 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T07:39:59:864905+0000", 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:40:14.536 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T07:39:59.865568+0000", 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.721+0000 7f7ab3a21640 1 Processor -- start 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.722+0000 7f7ab3a21640 1 -- start start 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.722+0000 7f7ab3a21640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac107c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.722+0000 7f7ab3a21640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac108230 con 0x7f7aac107860 2024-09-10T07:40:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.722+0000 7f7ab17bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.722+0000 7f7ab17bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac107c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53398/0 (socket says 172.21.15.73:53398) 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.722+0000 7f7ab17bd640 1 -- 172.21.15.73:0/3808660927 learned_addr learned my addr 172.21.15.73:0/3808660927 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.722+0000 7f7ab17bd640 1 -- 172.21.15.73:0/3808660927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aac108a10 con 0x7f7aac107860 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.723+0000 7f7ab17bd640 1 --2- 172.21.15.73:0/3808660927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac107c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009820 tx=0x7f7aa802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e657c6d5802278a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.723+0000 7f7aa3fff640 1 -- 172.21.15.73:0/3808660927 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa8037070 con 0x7f7aac107860 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.723+0000 7f7aa3fff640 1 -- 172.21.15.73:0/3808660927 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7aa8032900 con 0x7f7aac107860 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.723+0000 7f7aa3fff640 1 -- 172.21.15.73:0/3808660927 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa8030850 con 0x7f7aac107860 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.724+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3808660927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 msgr2=0x7f7aac107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.724+0000 7f7ab3a21640 1 --2- 172.21.15.73:0/3808660927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac107c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009820 tx=0x7f7aa802a270 comp rx=0 tx=0).stop 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.724+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3808660927 shutdown_connections 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.724+0000 7f7ab3a21640 1 --2- 172.21.15.73:0/3808660927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac107c60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.724+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3808660927 >> 172.21.15.73:0/3808660927 conn(0x7f7aac103010 msgr2=0x7f7aac105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:14.538 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.724+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3808660927 shutdown_connections 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.724+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3808660927 wait complete. 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7ab3a21640 1 Processor -- start 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7ab3a21640 1 -- start start 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7ab3a21640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7ab3a21640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac10bdc0 con 0x7f7aac107860 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7ab17bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7ab17bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53414/0 (socket says 172.21.15.73:53414) 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7ab17bd640 1 -- 172.21.15.73:0/3362552203 learned_addr learned my addr 172.21.15.73:0/3362552203 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7ab17bd640 1 -- 172.21.15.73:0/3362552203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aac19bd80 con 0x7f7aac107860 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7ab17bd640 1 --2- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac19b840 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80097f0 tx=0x7f7aa8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7aa27fc640 1 -- 172.21.15.73:0/3362552203 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa8037040 con 0x7f7aac107860 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.725+0000 7f7aa27fc640 1 -- 172.21.15.73:0/3362552203 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7aa8040070 con 0x7f7aac107860 2024-09-10T07:40:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.726+0000 7f7aa27fc640 1 -- 172.21.15.73:0/3362552203 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa803a390 con 0x7f7aac107860 2024-09-10T07:40:14.540 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.726+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aac19c010 con 0x7f7aac107860 2024-09-10T07:40:14.540 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.726+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aac19ed00 con 0x7f7aac107860 2024-09-10T07:40:14.540 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.726+0000 7f7aa27fc640 1 -- 172.21.15.73:0/3362552203 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f7aa803b430 con 0x7f7aac107860 2024-09-10T07:40:14.540 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.727+0000 7f7aa27fc640 1 --2- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f7a98038e60 0x7f7a9803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.540 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.727+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aac10bf40 con 0x7f7aac107860 2024-09-10T07:40:14.540 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.727+0000 7f7aa27fc640 1 -- 172.21.15.73:0/3362552203 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7aa806be70 con 0x7f7aac107860 2024-09-10T07:40:14.540 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.727+0000 7f7ab0fbc640 1 --2- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f7a98038e60 0x7f7a9803b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.727+0000 7f7ab0fbc640 1 --2- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f7a98038e60 0x7f7a9803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0098c0 tx=0x7f7a9c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.732+0000 7f7aa27fc640 1 -- 172.21.15.73:0/3362552203 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7aa8032900 con 0x7f7aac107860 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.764+0000 7f7aa27fc640 1 -- 172.21.15.73:0/3362552203 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f7aa8043c30 con 0x7f7aac107860 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.963+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7aac19eed0 con 0x7f7aac107860 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.963+0000 7f7aa27fc640 1 -- 172.21.15.73:0/3362552203 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f7aa8042790 con 0x7f7aac107860 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f7a98038e60 msgr2=0x7f7a9803b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 --2- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f7a98038e60 0x7f7a9803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0098c0 tx=0x7f7a9c006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 msgr2=0x7f7aac19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 --2- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac19b840 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80097f0 tx=0x7f7aa8030d80 comp rx=0 tx=0).stop 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 shutdown_connections 2024-09-10T07:40:14.541 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 --2- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f7a98038e60 0x7f7a9803b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.542 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 --2- 172.21.15.73:0/3362552203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7aac107860 0x7f7aac19b840 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.542 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 >> 172.21.15.73:0/3362552203 conn(0x7f7aac103010 msgr2=0x7f7aac103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:14.542 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 shutdown_connections 2024-09-10T07:40:14.542 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:13.965+0000 7f7ab3a21640 1 -- 172.21.15.73:0/3362552203 wait complete. 2024-09-10T07:40:14.542 INFO:teuthology.orchestra.run.smithi073.stdout:mgr is available 2024-09-10T07:40:14.786 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:14 smithi073 ceph-mon[30850]: mgrmap e4: x(active, since 2s) 2024-09-10T07:40:14.786 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:14 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3362552203' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T07:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T07:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout fsid = c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2024-09-10T07:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T07:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T07:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T07:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.948+0000 7efcc735d640 1 Processor -- start 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.948+0000 7efcc735d640 1 -- start start 2024-09-10T07:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.948+0000 7efcc735d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc0107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.948+0000 7efcc735d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efcc0108220 con 0x7efcc0107850 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.948+0000 7efcc50f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc0107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.948+0000 7efcc50f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc0107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53430/0 (socket says 172.21.15.73:53430) 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.948+0000 7efcc50f9640 1 -- 172.21.15.73:0/427972463 learned_addr learned my addr 172.21.15.73:0/427972463 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.948+0000 7efcc50f9640 1 -- 172.21.15.73:0/427972463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc0108a50 con 0x7efcc0107850 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.949+0000 7efcc50f9640 1 --2- 172.21.15.73:0/427972463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc0107c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009820 tx=0x7efcbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d650f4e760c5a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.949+0000 7efcb3fff640 1 -- 172.21.15.73:0/427972463 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcbc037070 con 0x7efcc0107850 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.949+0000 7efcb3fff640 1 -- 172.21.15.73:0/427972463 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcbc032900 con 0x7efcc0107850 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.949+0000 7efcb3fff640 1 -- 172.21.15.73:0/427972463 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcbc030850 con 0x7efcc0107850 2024-09-10T07:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.950+0000 7efcc735d640 1 -- 172.21.15.73:0/427972463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 msgr2=0x7efcc0107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.950+0000 7efcc735d640 1 --2- 172.21.15.73:0/427972463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc0107c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009820 tx=0x7efcbc02a270 comp rx=0 tx=0).stop 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.950+0000 7efcc735d640 1 -- 172.21.15.73:0/427972463 shutdown_connections 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.950+0000 7efcc735d640 1 --2- 172.21.15.73:0/427972463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc0107c50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.950+0000 7efcc735d640 1 -- 172.21.15.73:0/427972463 >> 172.21.15.73:0/427972463 conn(0x7efcc0102fc0 msgr2=0x7efcc0105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.950+0000 7efcc735d640 1 -- 172.21.15.73:0/427972463 shutdown_connections 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.950+0000 7efcc735d640 1 -- 172.21.15.73:0/427972463 wait complete. 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.950+0000 7efcc735d640 1 Processor -- start 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc735d640 1 -- start start 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc735d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc735d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efcc010be00 con 0x7efcc0107850 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc50f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc50f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc019b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53434/0 (socket says 172.21.15.73:53434) 2024-09-10T07:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc50f9640 1 -- 172.21.15.73:0/562823266 learned_addr learned my addr 172.21.15.73:0/562823266 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc50f9640 1 -- 172.21.15.73:0/562823266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc019be20 con 0x7efcc0107850 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc50f9640 1 --2- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc019b8e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0097f0 tx=0x7efcbc030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcb27fc640 1 -- 172.21.15.73:0/562823266 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcbc042070 con 0x7efcc0107850 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcb27fc640 1 -- 172.21.15.73:0/562823266 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcbc032ca0 con 0x7efcc0107850 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc019c0b0 con 0x7efcc0107850 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcb27fc640 1 -- 172.21.15.73:0/562823266 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcbc037040 con 0x7efcc0107850 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.951+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc019eda0 con 0x7efcc0107850 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.952+0000 7efcb27fc640 1 -- 172.21.15.73:0/562823266 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7efcbc045070 con 0x7efcc0107850 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.952+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc010bf80 con 0x7efcc0107850 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.952+0000 7efcb27fc640 1 --2- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7efcac038f70 0x7efcac03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.952+0000 7efcb27fc640 1 -- 172.21.15.73:0/562823266 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efcbc06c020 con 0x7efcc0107850 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.953+0000 7efcc48f8640 1 --2- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7efcac038f70 0x7efcac03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.953+0000 7efcc48f8640 1 --2- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7efcac038f70 0x7efcac03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efcb40098c0 tx=0x7efcb4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:14.957+0000 7efcb27fc640 1 -- 172.21.15.73:0/562823266 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcbc045360 con 0x7efcc0107850 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.121+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7efcc0107cd0 con 0x7efcc0107850 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.122+0000 7efcb27fc640 1 -- 172.21.15.73:0/562823266 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+454 (secure 0 0 0) 0x7efcbc050e90 con 0x7efcc0107850 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7efcac038f70 msgr2=0x7efcac03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 --2- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7efcac038f70 0x7efcac03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efcb40098c0 tx=0x7efcb4006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 msgr2=0x7efcc019b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 --2- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc019b8e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0097f0 tx=0x7efcbc030ec0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 shutdown_connections 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 --2- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7efcac038f70 0x7efcac03b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 --2- 172.21.15.73:0/562823266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc0107850 0x7efcc019b8e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 >> 172.21.15.73:0/562823266 conn(0x7efcc0102fc0 msgr2=0x7efcc0103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 shutdown_connections 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:15.125+0000 7efcc735d640 1 -- 172.21.15.73:0/562823266 wait complete. 2024-09-10T07:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling cephadm module... 2024-09-10T07:40:15.952 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:15 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/562823266' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T07:40:17.090 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:16 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1037114316' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T07:40:17.091 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: ignoring --setuser ceph since I am not root 2024-09-10T07:40:17.091 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: ignoring --setgroup ceph since I am not root 2024-09-10T07:40:17.091 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:16.910+0000 7f5fc2e81040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:40:17.091 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:16.965+0000 7f5fc2e81040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:40:17.366 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:17.114+0000 7f5fc2e81040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:40:17.366 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:17.180+0000 7f5fc2e81040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:40:17.366 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:17.326+0000 7f5fc2e81040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:40:17.374 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.141+0000 7f2495e50640 1 Processor -- start 2024-09-10T07:40:17.374 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.141+0000 7f2495e50640 1 -- start start 2024-09-10T07:40:17.374 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.142+0000 7f2495e50640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.374 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.142+0000 7f2495e50640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f24901070e0 con 0x7f2490106710 2024-09-10T07:40:17.374 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.142+0000 7f248f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.374 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.142+0000 7f248f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53438/0 (socket says 172.21.15.73:53438) 2024-09-10T07:40:17.374 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.142+0000 7f248f7fe640 1 -- 172.21.15.73:0/2967969362 learned_addr learned my addr 172.21.15.73:0/2967969362 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:17.374 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.142+0000 7f248f7fe640 1 -- 172.21.15.73:0/2967969362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2490107910 con 0x7f2490106710 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.143+0000 7f248f7fe640 1 --2- 172.21.15.73:0/2967969362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490106b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2480009820 tx=0x7f248002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d55350e54ff231 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.143+0000 7f248e7fc640 1 -- 172.21.15.73:0/2967969362 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2480037070 con 0x7f2490106710 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.143+0000 7f248e7fc640 1 -- 172.21.15.73:0/2967969362 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2480032900 con 0x7f2490106710 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.143+0000 7f248e7fc640 1 -- 172.21.15.73:0/2967969362 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2480030850 con 0x7f2490106710 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.144+0000 7f2495e50640 1 -- 172.21.15.73:0/2967969362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 msgr2=0x7f2490106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.144+0000 7f2495e50640 1 --2- 172.21.15.73:0/2967969362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490106b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2480009820 tx=0x7f248002a270 comp rx=0 tx=0).stop 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.144+0000 7f2495e50640 1 -- 172.21.15.73:0/2967969362 shutdown_connections 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.144+0000 7f2495e50640 1 --2- 172.21.15.73:0/2967969362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490106b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.144+0000 7f2495e50640 1 -- 172.21.15.73:0/2967969362 >> 172.21.15.73:0/2967969362 conn(0x7f2490101e80 msgr2=0x7f24901042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.144+0000 7f2495e50640 1 -- 172.21.15.73:0/2967969362 shutdown_connections 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.144+0000 7f2495e50640 1 -- 172.21.15.73:0/2967969362 wait complete. 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.145+0000 7f2495e50640 1 Processor -- start 2024-09-10T07:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.145+0000 7f2495e50640 1 -- start start 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.145+0000 7f2495e50640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490191940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.145+0000 7f2495e50640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f249010acc0 con 0x7f2490106710 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.145+0000 7f248f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490191940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.145+0000 7f248f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490191940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53454/0 (socket says 172.21.15.73:53454) 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.145+0000 7f248f7fe640 1 -- 172.21.15.73:0/1037114316 learned_addr learned my addr 172.21.15.73:0/1037114316 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.145+0000 7f248f7fe640 1 -- 172.21.15.73:0/1037114316 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2490191e80 con 0x7f2490106710 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.146+0000 7f248f7fe640 1 --2- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490191940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24800097f0 tx=0x7f2480030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.146+0000 7f248cff9640 1 -- 172.21.15.73:0/1037114316 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2480037040 con 0x7f2490106710 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.146+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2490190070 con 0x7f2490106710 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.146+0000 7f248cff9640 1 -- 172.21.15.73:0/1037114316 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2480040070 con 0x7f2490106710 2024-09-10T07:40:17.376 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.146+0000 7f248cff9640 1 -- 172.21.15.73:0/1037114316 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f248003a390 con 0x7f2490106710 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.146+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2490190550 con 0x7f2490106710 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.147+0000 7f248cff9640 1 -- 172.21.15.73:0/1037114316 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f248003a650 con 0x7f2490106710 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.147+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249010ae40 con 0x7f2490106710 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.147+0000 7f248cff9640 1 --2- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2478038f20 0x7f247803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.147+0000 7f248cff9640 1 -- 172.21.15.73:0/1037114316 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f248006c130 con 0x7f2490106710 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.147+0000 7f248effd640 1 --2- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2478038f20 0x7f247803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.148+0000 7f248effd640 1 --2- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2478038f20 0x7f247803b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24840098c0 tx=0x7f2484006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.152+0000 7f248cff9640 1 -- 172.21.15.73:0/1037114316 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f248003a9f0 con 0x7f2490106710 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.379+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f24901956c0 con 0x7f2490106710 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.767+0000 7f248cff9640 1 -- 172.21.15.73:0/1037114316 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f2480043520 con 0x7f2490106710 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.769+0000 7f248cff9640 1 -- 172.21.15.73:0/1037114316 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f248002fd60 con 0x7f2490106710 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2478038f20 msgr2=0x7f247803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 --2- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2478038f20 0x7f247803b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24840098c0 tx=0x7f2484006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 msgr2=0x7f2490191940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.378 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 --2- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490191940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24800097f0 tx=0x7f2480030d80 comp rx=0 tx=0).stop 2024-09-10T07:40:17.378 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 shutdown_connections 2024-09-10T07:40:17.378 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 --2- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2478038f20 0x7f247803b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.378 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 --2- 172.21.15.73:0/1037114316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2490106710 0x7f2490191940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.378 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 >> 172.21.15.73:0/1037114316 conn(0x7f2490101e80 msgr2=0x7f2490102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:17.378 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 shutdown_connections 2024-09-10T07:40:17.378 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:16.771+0000 7f2495e50640 1 -- 172.21.15.73:0/1037114316 wait complete. 2024-09-10T07:40:17.641 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:17.471+0000 7f5fc2e81040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:40:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:17 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1037114316' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T07:40:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:17 smithi073 ceph-mon[30850]: mgrmap e5: x(active, since 5s) 2024-09-10T07:40:17.973 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:17.788+0000 7f5fc2e81040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:40:17.973 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:17.853+0000 7f5fc2e81040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:40:18.397 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:18.039+0000 7f5fc2e81040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:40:18.681 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:40:18.681 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.825+0000 7f8243cf5640 1 Processor -- start 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.825+0000 7f8243cf5640 1 -- start start 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.825+0000 7f8243cf5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c10a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.825+0000 7f8243cf5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f823c07bed0 con 0x7f823c108280 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.825+0000 7f8241a91640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c10a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.826+0000 7f8241a91640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c10a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53478/0 (socket says 172.21.15.73:53478) 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.826+0000 7f8241a91640 1 -- 172.21.15.73:0/3965217953 learned_addr learned my addr 172.21.15.73:0/3965217953 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.826+0000 7f8241a91640 1 -- 172.21.15.73:0/3965217953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c10abb0 con 0x7f823c108280 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.826+0000 7f8241a91640 1 --2- 172.21.15.73:0/3965217953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c10a670 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f822c009820 tx=0x7f822c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4ed8dae7c6225d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8240a8f640 1 -- 172.21.15.73:0/3965217953 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c037070 con 0x7f823c108280 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8240a8f640 1 -- 172.21.15.73:0/3965217953 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f822c032900 con 0x7f823c108280 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8240a8f640 1 -- 172.21.15.73:0/3965217953 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c030850 con 0x7f823c108280 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8243cf5640 1 -- 172.21.15.73:0/3965217953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 msgr2=0x7f823c10a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8243cf5640 1 --2- 172.21.15.73:0/3965217953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c10a670 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f822c009820 tx=0x7f822c02a270 comp rx=0 tx=0).stop 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8243cf5640 1 -- 172.21.15.73:0/3965217953 shutdown_connections 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8243cf5640 1 --2- 172.21.15.73:0/3965217953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c10a670 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8243cf5640 1 -- 172.21.15.73:0/3965217953 >> 172.21.15.73:0/3965217953 conn(0x7f823c101e80 msgr2=0x7f823c1042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8243cf5640 1 -- 172.21.15.73:0/3965217953 shutdown_connections 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.827+0000 7f8243cf5640 1 -- 172.21.15.73:0/3965217953 wait complete. 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.828+0000 7f8243cf5640 1 Processor -- start 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.828+0000 7f8243cf5640 1 -- start start 2024-09-10T07:40:18.683 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.828+0000 7f8243cf5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c107b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.828+0000 7f8243cf5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f823c10bc50 con 0x7f823c108280 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.828+0000 7f8241a91640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.828+0000 7f8241a91640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53488/0 (socket says 172.21.15.73:53488) 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.828+0000 7f8241a91640 1 -- 172.21.15.73:0/4091498685 learned_addr learned my addr 172.21.15.73:0/4091498685 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.828+0000 7f8241a91640 1 -- 172.21.15.73:0/4091498685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c108040 con 0x7f823c108280 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.829+0000 7f8241a91640 1 --2- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c107b00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f822c032ce0 tx=0x7f822c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.829+0000 7f8232ffd640 1 -- 172.21.15.73:0/4091498685 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c042070 con 0x7f823c108280 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.829+0000 7f8232ffd640 1 -- 172.21.15.73:0/4091498685 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f822c0308c0 con 0x7f823c108280 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.829+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823c106230 con 0x7f823c108280 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.829+0000 7f8232ffd640 1 -- 172.21.15.73:0/4091498685 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c037040 con 0x7f823c108280 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.829+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823c106770 con 0x7f823c108280 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.830+0000 7f8232ffd640 1 -- 172.21.15.73:0/4091498685 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f822c045070 con 0x7f823c108280 2024-09-10T07:40:18.684 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.830+0000 7f8232ffd640 1 --2- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f8228038f70 0x7f822803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.830+0000 7f8232ffd640 1 -- 172.21.15.73:0/4091498685 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f822c06bfb0 con 0x7f823c108280 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.830+0000 7f8241290640 1 -- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f8228038f70 msgr2=0x7f822803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/435372869 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.830+0000 7f8241290640 1 --2- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f8228038f70 0x7f822803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.830+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823c1086e0 con 0x7f823c108280 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:17.835+0000 7f8232ffd640 1 -- 172.21.15.73:0/4091498685 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f822c04b170 con 0x7f823c108280 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.031+0000 7f8241290640 1 -- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f8228038f70 msgr2=0x7f822803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/435372869 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.031+0000 7f8241290640 1 --2- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f8228038f70 0x7f822803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.047+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f823c106e70 con 0x7f823c108280 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.048+0000 7f8232ffd640 1 -- 172.21.15.73:0/4091498685 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f822c042d00 con 0x7f823c108280 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f8228038f70 msgr2=0x7f822803b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 --2- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f8228038f70 0x7f822803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 msgr2=0x7f823c107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:18.685 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 --2- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c107b00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f822c032ce0 tx=0x7f822c032d10 comp rx=0 tx=0).stop 2024-09-10T07:40:18.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 shutdown_connections 2024-09-10T07:40:18.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 --2- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f8228038f70 0x7f822803b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 --2- 172.21.15.73:0/4091498685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823c108280 0x7f823c107b00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 >> 172.21.15.73:0/4091498685 conn(0x7f823c101e80 msgr2=0x7f823c102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:18.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 shutdown_connections 2024-09-10T07:40:18.686 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:18.050+0000 7f8243cf5640 1 -- 172.21.15.73:0/4091498685 wait complete. 2024-09-10T07:40:18.686 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for the mgr to restart... 2024-09-10T07:40:18.686 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr epoch 5... 2024-09-10T07:40:18.953 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:18 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4091498685' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T07:40:19.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:18.953+0000 7f5fc2e81040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:40:19.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:19.022+0000 7f5fc2e81040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:40:19.972 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:19.732+0000 7f5fc2e81040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:40:19.972 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:19.848+0000 7f5fc2e81040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:40:20.268 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:19.990+0000 7f5fc2e81040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:40:20.268 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.052+0000 7f5fc2e81040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:40:20.269 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.200+0000 7f5fc2e81040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:40:20.269 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.268+0000 7f5fc2e81040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:40:20.549 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.328+0000 7f5fc2e81040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:40:20.549 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.484+0000 7f5fc2e81040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:40:20.549 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.549+0000 7f5fc2e81040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:40:20.816 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.616+0000 7f5fc2e81040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:40:20.816 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.698+0000 7f5fc2e81040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:40:20.816 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.756+0000 7f5fc2e81040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:40:20.816 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:20.816+0000 7f5fc2e81040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:40:21.972 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:21.599+0000 7f5fc2e81040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:40:21.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: Active manager daemon x restarted 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: Activating manager daemon x 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: mgrmap e6: x(active, starting, since 0.00336921s) 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: Manager daemon x is now available 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:40:21.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T07:40:21.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:21 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T07:40:22.921 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:22 smithi073 ceph-mon[30850]: Found migration_current of "None". Setting to last migration. 2024-09-10T07:40:22.921 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:22 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:22.921 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:22 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:22.921 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:22 smithi073 ceph-mon[30850]: mgrmap e7: x(active, since 1.00567s) 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.089+0000 7f2ac014d640 1 Processor -- start 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.089+0000 7f2ac014d640 1 -- start start 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.089+0000 7f2ac014d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.089+0000 7f2ac014d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab81064f0 con 0x7f2ab8105b20 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.089+0000 7f2abdee9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.164 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.089+0000 7f2abdee9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53496/0 (socket says 172.21.15.73:53496) 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.089+0000 7f2abdee9640 1 -- 172.21.15.73:0/3589890934 learned_addr learned my addr 172.21.15.73:0/3589890934 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.090+0000 7f2abdee9640 1 -- 172.21.15.73:0/3589890934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab8106670 con 0x7f2ab8105b20 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.090+0000 7f2abdee9640 1 --2- 172.21.15.73:0/3589890934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8105f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009820 tx=0x7f2ab402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc74bfa037e4901 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.090+0000 7f2abcee7640 1 -- 172.21.15.73:0/3589890934 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab4037070 con 0x7f2ab8105b20 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.090+0000 7f2abcee7640 1 -- 172.21.15.73:0/3589890934 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ab4032900 con 0x7f2ab8105b20 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.090+0000 7f2abcee7640 1 -- 172.21.15.73:0/3589890934 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab4030850 con 0x7f2ab8105b20 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.091+0000 7f2ac014d640 1 -- 172.21.15.73:0/3589890934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 msgr2=0x7f2ab8105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.091+0000 7f2ac014d640 1 --2- 172.21.15.73:0/3589890934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8105f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009820 tx=0x7f2ab402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.091+0000 7f2ac014d640 1 -- 172.21.15.73:0/3589890934 shutdown_connections 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.091+0000 7f2ac014d640 1 --2- 172.21.15.73:0/3589890934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8105f20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.091+0000 7f2ac014d640 1 -- 172.21.15.73:0/3589890934 >> 172.21.15.73:0/3589890934 conn(0x7f2ab8101610 msgr2=0x7f2ab8103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:23.165 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.091+0000 7f2ac014d640 1 -- 172.21.15.73:0/3589890934 shutdown_connections 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.091+0000 7f2ac014d640 1 -- 172.21.15.73:0/3589890934 wait complete. 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.092+0000 7f2ac014d640 1 Processor -- start 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.092+0000 7f2ac014d640 1 -- start start 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.092+0000 7f2ac014d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8108420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.092+0000 7f2ac014d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8109a00 con 0x7f2ab8105b20 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.092+0000 7f2abdee9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.092+0000 7f2abdee9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8108420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53512/0 (socket says 172.21.15.73:53512) 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.092+0000 7f2abdee9640 1 -- 172.21.15.73:0/2735991969 learned_addr learned my addr 172.21.15.73:0/2735991969 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.092+0000 7f2abdee9640 1 -- 172.21.15.73:0/2735991969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab8108960 con 0x7f2ab8105b20 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.092+0000 7f2abdee9640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8108420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009940 tx=0x7f2ab40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.093+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab4042070 con 0x7f2ab8105b20 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.093+0000 7f2ac014d640 1 -- 172.21.15.73:0/2735991969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab8106b50 con 0x7f2ab8105b20 2024-09-10T07:40:23.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.093+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ab4032be0 con 0x7f2ab8105b20 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.093+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab4037040 con 0x7f2ab8105b20 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.093+0000 7f2ac014d640 1 -- 172.21.15.73:0/2735991969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab8107090 con 0x7f2ab8105b20 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.094+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f2ab4045070 con 0x7f2ab8105b20 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.094+0000 7f2aaeffd640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 0x7f2aa403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.094+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 --> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2aa403bb40 con 0x7f2aa4038f70 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.094+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2ab406bed0 con 0x7f2ab8105b20 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.094+0000 7f2abd6e8640 1 -- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 msgr2=0x7f2aa403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/435372869 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.094+0000 7f2abd6e8640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 0x7f2aa403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.295+0000 7f2abd6e8640 1 -- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 msgr2=0x7f2aa403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/435372869 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.295+0000 7f2abd6e8640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 0x7f2aa403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.696+0000 7f2abd6e8640 1 -- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 msgr2=0x7f2aa403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/435372869 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:19.696+0000 7f2abd6e8640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 0x7f2aa403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:20.497+0000 7f2abd6e8640 1 -- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 msgr2=0x7f2aa403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/435372869 2024-09-10T07:40:23.167 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:20.497+0000 7f2abd6e8640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 0x7f2aa403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:21.603+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f2ab406a990 con 0x7f2ab8105b20 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:21.603+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 msgr2=0x7f2aa403b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:21.603+0000 7f2aaeffd640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 0x7f2aa403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.604+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f2ab403b330 con 0x7f2ab8105b20 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.604+0000 7f2aaeffd640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2aa403c8a0 0x7f2aa403ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.604+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2ab4001d30 con 0x7f2aa403c8a0 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.604+0000 7f2abd6e8640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2aa403c8a0 0x7f2aa403ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.605+0000 7f2abd6e8640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2aa403c8a0 0x7f2aa403ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8003980 tx=0x7f2aa8006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.606+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 <== mgr.14118 v2:172.21.15.73:6800/142266274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f2ab4001d30 con 0x7f2aa403c8a0 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 -- 172.21.15.73:0/2735991969 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f2ab8105fa0 con 0x7f2aa403c8a0 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2aaeffd640 1 -- 172.21.15.73:0/2735991969 <== mgr.14118 v2:172.21.15.73:6800/142266274 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f2ab8105fa0 con 0x7f2aa403c8a0 2024-09-10T07:40:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 -- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2aa403c8a0 msgr2=0x7f2aa403ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2aa403c8a0 0x7f2aa403ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8003980 tx=0x7f2aa8006e10 comp rx=0 tx=0).stop 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 -- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 msgr2=0x7f2ab8108420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8108420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009940 tx=0x7f2ab40326e0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 -- 172.21.15.73:0/2735991969 shutdown_connections 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2aa403c8a0 0x7f2aa403ec90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:6800/435372869,v1:172.21.15.73:6801/435372869] conn(0x7f2aa4038f70 0x7f2aa403b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 --2- 172.21.15.73:0/2735991969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ab8105b20 0x7f2ab8108420 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 -- 172.21.15.73:0/2735991969 >> 172.21.15.73:0/2735991969 conn(0x7f2ab8101610 msgr2=0x7f2ab8102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.618+0000 7f2ac014d640 1 -- 172.21.15.73:0/2735991969 shutdown_connections 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:22.619+0000 7f2ac014d640 1 -- 172.21.15.73:0/2735991969 wait complete. 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:mgr epoch 5 is available 2024-09-10T07:40:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:Setting orchestrator backend to cephadm... 2024-09-10T07:40:23.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-mon[30850]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T07:40:23.866 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-mon[30850]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:23.867+0000 7f5f2f9df640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:07:40:23] ENGINE Error in HTTPServer.serve 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: Traceback (most recent call last): 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self._connections.run(self.expiration_interval) 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self._run(expiration_interval) 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:40:24.138 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: s = self.context.wrap_socket( 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: return self.sslsocket_class._create( 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self.do_handshake() 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self._sslobj.do_handshake() 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:40:24.139 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:24.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.577+0000 7fa8f41f6640 1 Processor -- start 2024-09-10T07:40:24.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.577+0000 7fa8f41f6640 1 -- start start 2024-09-10T07:40:24.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.577+0000 7fa8f41f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec107c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:24.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.577+0000 7fa8f41f6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec108230 con 0x7fa8ec107860 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.577+0000 7fa8f1f92640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.577+0000 7fa8f1f92640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec107c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36944/0 (socket says 172.21.15.73:36944) 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.577+0000 7fa8f1f92640 1 -- 172.21.15.73:0/1077672859 learned_addr learned my addr 172.21.15.73:0/1077672859 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.578+0000 7fa8f1f92640 1 -- 172.21.15.73:0/1077672859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec108a10 con 0x7fa8ec107860 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.578+0000 7fa8f1f92640 1 --2- 172.21.15.73:0/1077672859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec107c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009820 tx=0x7fa8e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688d243172537e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f0f90640 1 -- 172.21.15.73:0/1077672859 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e8037070 con 0x7fa8ec107860 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f0f90640 1 -- 172.21.15.73:0/1077672859 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8e8032900 con 0x7fa8ec107860 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f0f90640 1 -- 172.21.15.73:0/1077672859 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e8030850 con 0x7fa8ec107860 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f41f6640 1 -- 172.21.15.73:0/1077672859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 msgr2=0x7fa8ec107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f41f6640 1 --2- 172.21.15.73:0/1077672859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec107c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009820 tx=0x7fa8e802a270 comp rx=0 tx=0).stop 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f41f6640 1 -- 172.21.15.73:0/1077672859 shutdown_connections 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f41f6640 1 --2- 172.21.15.73:0/1077672859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec107c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f41f6640 1 -- 172.21.15.73:0/1077672859 >> 172.21.15.73:0/1077672859 conn(0x7fa8ec103010 msgr2=0x7fa8ec105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:24.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f41f6640 1 -- 172.21.15.73:0/1077672859 shutdown_connections 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.579+0000 7fa8f41f6640 1 -- 172.21.15.73:0/1077672859 wait complete. 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.580+0000 7fa8f41f6640 1 Processor -- start 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.580+0000 7fa8f41f6640 1 -- start start 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.580+0000 7fa8f41f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.580+0000 7fa8f41f6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec10bdc0 con 0x7fa8ec107860 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.580+0000 7fa8f1f92640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.580+0000 7fa8f1f92640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36960/0 (socket says 172.21.15.73:36960) 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.580+0000 7fa8f1f92640 1 -- 172.21.15.73:0/2720997303 learned_addr learned my addr 172.21.15.73:0/2720997303 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.580+0000 7fa8f1f92640 1 -- 172.21.15.73:0/2720997303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec19bd80 con 0x7fa8ec107860 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.581+0000 7fa8f1f92640 1 --2- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec19b840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009940 tx=0x7fa8e8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.581+0000 7fa8e2ffd640 1 -- 172.21.15.73:0/2720997303 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e8042070 con 0x7fa8ec107860 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.581+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec19c010 con 0x7fa8ec107860 2024-09-10T07:40:24.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.581+0000 7fa8e2ffd640 1 -- 172.21.15.73:0/2720997303 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8e80308c0 con 0x7fa8ec107860 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.581+0000 7fa8e2ffd640 1 -- 172.21.15.73:0/2720997303 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e8037040 con 0x7fa8ec107860 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.581+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec19ed00 con 0x7fa8ec107860 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.582+0000 7fa8e2ffd640 1 -- 172.21.15.73:0/2720997303 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fa8e8045070 con 0x7fa8ec107860 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.582+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ec10bf40 con 0x7fa8ec107860 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.582+0000 7fa8e2ffd640 1 --2- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fa8d8038e60 0x7fa8d803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.582+0000 7fa8e2ffd640 1 -- 172.21.15.73:0/2720997303 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa8e806be80 con 0x7fa8ec107860 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.582+0000 7fa8f1791640 1 --2- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fa8d8038e60 0x7fa8d803b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.582+0000 7fa8f1791640 1 --2- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fa8d8038e60 0x7fa8d803b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0098c0 tx=0x7fa8dc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.591+0000 7fa8e2ffd640 1 -- 172.21.15.73:0/2720997303 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8e803cd90 con 0x7fa8ec107860 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.659+0000 7fa8e2ffd640 1 -- 172.21.15.73:0/2720997303 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa8e80327b0 con 0x7fa8ec107860 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.774+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fa8ec104290 con 0x7fa8d8038e60 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.780+0000 7fa8e2ffd640 1 -- 172.21.15.73:0/2720997303 <== mgr.14118 v2:172.21.15.73:6800/142266274 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa8ec104290 con 0x7fa8d8038e60 2024-09-10T07:40:24.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fa8d8038e60 msgr2=0x7fa8d803b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:24.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 --2- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fa8d8038e60 0x7fa8d803b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0098c0 tx=0x7fa8dc006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 msgr2=0x7fa8ec19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:24.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 --2- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec19b840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009940 tx=0x7fa8e8032ce0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 shutdown_connections 2024-09-10T07:40:24.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 --2- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fa8d8038e60 0x7fa8d803b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 --2- 172.21.15.73:0/2720997303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8ec107860 0x7fa8ec19b840 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 >> 172.21.15.73:0/2720997303 conn(0x7fa8ec103010 msgr2=0x7fa8ec103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:24.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 shutdown_connections 2024-09-10T07:40:24.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:23.782+0000 7fa8f41f6640 1 -- 172.21.15.73:0/2720997303 wait complete. 2024-09-10T07:40:24.713 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:24 smithi073 ceph-mon[30850]: mgrmap e8: x(active, since 2s) 2024-09-10T07:40:24.713 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:24 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:23] ENGINE Bus STARTING 2024-09-10T07:40:24.713 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:24 smithi073 ceph-mon[30850]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:24.713 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:24 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:24.713 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:24 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:40:24.713 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:24 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.710+0000 7fe4ed32a640 1 Processor -- start 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.710+0000 7fe4ed32a640 1 -- start start 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.710+0000 7fe4ed32a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e8106b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.710+0000 7fe4ed32a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8107120 con 0x7fe4e8106750 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.710+0000 7fe4e6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e8106b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.710+0000 7fe4e6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e8106b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36968/0 (socket says 172.21.15.73:36968) 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.710+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/852696617 learned_addr learned my addr 172.21.15.73:0/852696617 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.710+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/852696617 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e8107950 con 0x7fe4e8106750 2024-09-10T07:40:25.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.711+0000 7fe4e6ffd640 1 --2- 172.21.15.73:0/852696617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e8106b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009820 tx=0x7fe4d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b6a1bccf8fd834 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.711+0000 7fe4e67fc640 1 -- 172.21.15.73:0/852696617 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8037070 con 0x7fe4e8106750 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.711+0000 7fe4e67fc640 1 -- 172.21.15.73:0/852696617 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4d8032900 con 0x7fe4e8106750 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.711+0000 7fe4e67fc640 1 -- 172.21.15.73:0/852696617 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8030850 con 0x7fe4e8106750 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.712+0000 7fe4ed32a640 1 -- 172.21.15.73:0/852696617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 msgr2=0x7fe4e8106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.712+0000 7fe4ed32a640 1 --2- 172.21.15.73:0/852696617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e8106b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009820 tx=0x7fe4d802a270 comp rx=0 tx=0).stop 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.712+0000 7fe4ed32a640 1 -- 172.21.15.73:0/852696617 shutdown_connections 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.712+0000 7fe4ed32a640 1 --2- 172.21.15.73:0/852696617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e8106b50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.712+0000 7fe4ed32a640 1 -- 172.21.15.73:0/852696617 >> 172.21.15.73:0/852696617 conn(0x7fe4e8101ea0 msgr2=0x7fe4e8104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.712+0000 7fe4ed32a640 1 -- 172.21.15.73:0/852696617 shutdown_connections 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.712+0000 7fe4ed32a640 1 -- 172.21.15.73:0/852696617 wait complete. 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.712+0000 7fe4ed32a640 1 Processor -- start 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.713+0000 7fe4ed32a640 1 -- start start 2024-09-10T07:40:25.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.713+0000 7fe4ed32a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.713+0000 7fe4ed32a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e810ad00 con 0x7fe4e8106750 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.713+0000 7fe4e6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.713+0000 7fe4e6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e819b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36982/0 (socket says 172.21.15.73:36982) 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.713+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/1050694845 learned_addr learned my addr 172.21.15.73:0/1050694845 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.713+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/1050694845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e819be60 con 0x7fe4e8106750 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.713+0000 7fe4e6ffd640 1 --2- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e819b920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80097f0 tx=0x7fe4d8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.714+0000 7fe4e4ff9640 1 -- 172.21.15.73:0/1050694845 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8042070 con 0x7fe4e8106750 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.714+0000 7fe4e4ff9640 1 -- 172.21.15.73:0/1050694845 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4d8032ca0 con 0x7fe4e8106750 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.714+0000 7fe4e4ff9640 1 -- 172.21.15.73:0/1050694845 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8037040 con 0x7fe4e8106750 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.714+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e819c0f0 con 0x7fe4e8106750 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.714+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e819ede0 con 0x7fe4e8106750 2024-09-10T07:40:25.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.715+0000 7fe4e4ff9640 1 -- 172.21.15.73:0/1050694845 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe4d8045070 con 0x7fe4e8106750 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.715+0000 7fe4e4ff9640 1 --2- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fe4d4038fc0 0x7fe4d403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.715+0000 7fe4e4ff9640 1 -- 172.21.15.73:0/1050694845 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe4d806bec0 con 0x7fe4e8106750 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.715+0000 7fe4de7fc640 1 --2- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fe4d4038fc0 0x7fe4d403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.715+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e810ae80 con 0x7fe4e8106750 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.715+0000 7fe4de7fc640 1 --2- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fe4d4038fc0 0x7fe4d403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00098c0 tx=0x7fe4d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.720+0000 7fe4e4ff9640 1 -- 172.21.15.73:0/1050694845 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4d8045360 con 0x7fe4e8106750 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.890+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fe4e802d9b0 con 0x7fe4d4038fc0 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.890+0000 7fe4e4ff9640 1 -- 172.21.15.73:0/1050694845 <== mgr.14118 v2:172.21.15.73:6800/142266274 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fe4e802d9b0 con 0x7fe4d4038fc0 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.892+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fe4d4038fc0 msgr2=0x7fe4d403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.892+0000 7fe4ed32a640 1 --2- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fe4d4038fc0 0x7fe4d403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00098c0 tx=0x7fe4d0006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.892+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 msgr2=0x7fe4e819b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.892+0000 7fe4ed32a640 1 --2- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e819b920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80097f0 tx=0x7fe4d8030ec0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.892+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 shutdown_connections 2024-09-10T07:40:25.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.892+0000 7fe4ed32a640 1 --2- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fe4d4038fc0 0x7fe4d403b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.892+0000 7fe4ed32a640 1 --2- 172.21.15.73:0/1050694845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e8106750 0x7fe4e819b920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.892+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 >> 172.21.15.73:0/1050694845 conn(0x7fe4e8101ea0 msgr2=0x7fe4e8102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:25.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.893+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 shutdown_connections 2024-09-10T07:40:25.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:24.893+0000 7fe4ed32a640 1 -- 172.21.15.73:0/1050694845 wait complete. 2024-09-10T07:40:25.464 INFO:teuthology.orchestra.run.smithi073.stdout:Generating ssh key... 2024-09-10T07:40:25.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:25 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:23] ENGINE Serving on https://172.21.15.73:7150 2024-09-10T07:40:25.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:25 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:23] ENGINE Error in HTTPServer.serve 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: Traceback (most recent call last): 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._connections.run(self.expiration_interval) 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._run(expiration_interval) 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: s = self.context.wrap_socket( 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: return self.sslsocket_class._create( 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:40:25.723 INFO:journalctl@ceph.mon.a.smithi073.stdout: self.do_handshake() 2024-09-10T07:40:25.724 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:40:25.724 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._sslobj.do_handshake() 2024-09-10T07:40:25.724 INFO:journalctl@ceph.mon.a.smithi073.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:40:25.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:25 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:23] ENGINE Serving on http://172.21.15.73:8765 2024-09-10T07:40:25.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:25 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:23] ENGINE Bus STARTED 2024-09-10T07:40:26.362 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: Generating public/private rsa key pair. 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: Your identification has been saved in /tmp/tmp85bns_pg/key 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: Your public key has been saved in /tmp/tmp85bns_pg/key.pub 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: The key fingerprint is: 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: SHA256:tP73zcmXkkU+Qy/inJTHY2aqgzFQXQ5hFpdWsLGA03s ceph-c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: The key's randomart image is: 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: +---[RSA 3072]----+ 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: | +B+=+. | 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: | +oo=o+ | 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: | ... o+ | 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: | .. .. E o | 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: | .S . o+ .| 2024-09-10T07:40:26.363 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: | .o + O=.| 2024-09-10T07:40:26.364 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: | .+ + Ooo+| 2024-09-10T07:40:26.364 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: | ... *o.+o| 2024-09-10T07:40:26.364 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: | o+ .oo+| 2024-09-10T07:40:26.364 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: +----[SHA256]-----+ 2024-09-10T07:40:26.926 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-mon[30850]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:26.926 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:26.926 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:26 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:26.933 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.934+0000 7f4712c42640 1 Processor -- start 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.934+0000 7f4712c42640 1 -- start start 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.934+0000 7f4712c42640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.934+0000 7f4712c42640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f470c108220 con 0x7f470c107850 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.934+0000 7f47109de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.934+0000 7f47109de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36984/0 (socket says 172.21.15.73:36984) 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.934+0000 7f47109de640 1 -- 172.21.15.73:0/16854259 learned_addr learned my addr 172.21.15.73:0/16854259 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.934+0000 7f47109de640 1 -- 172.21.15.73:0/16854259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c108a50 con 0x7f470c107850 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.935+0000 7f47109de640 1 --2- 172.21.15.73:0/16854259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c107c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4704009820 tx=0x7f470402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4929ff83a423457 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.935+0000 7f470b7fe640 1 -- 172.21.15.73:0/16854259 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4704037070 con 0x7f470c107850 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.935+0000 7f470b7fe640 1 -- 172.21.15.73:0/16854259 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4704032900 con 0x7f470c107850 2024-09-10T07:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.935+0000 7f470b7fe640 1 -- 172.21.15.73:0/16854259 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4704030850 con 0x7f470c107850 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.936+0000 7f4712c42640 1 -- 172.21.15.73:0/16854259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 msgr2=0x7f470c107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.936+0000 7f4712c42640 1 --2- 172.21.15.73:0/16854259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c107c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4704009820 tx=0x7f470402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.936+0000 7f4712c42640 1 -- 172.21.15.73:0/16854259 shutdown_connections 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.936+0000 7f4712c42640 1 --2- 172.21.15.73:0/16854259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c107c50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.936+0000 7f4712c42640 1 -- 172.21.15.73:0/16854259 >> 172.21.15.73:0/16854259 conn(0x7f470c102fc0 msgr2=0x7f470c105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.936+0000 7f4712c42640 1 -- 172.21.15.73:0/16854259 shutdown_connections 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.936+0000 7f4712c42640 1 -- 172.21.15.73:0/16854259 wait complete. 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.936+0000 7f4712c42640 1 Processor -- start 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f4712c42640 1 -- start start 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f4712c42640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f4712c42640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f470c10be00 con 0x7f470c107850 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f47109de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.935 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f47109de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c19b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37000/0 (socket says 172.21.15.73:37000) 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f47109de640 1 -- 172.21.15.73:0/528281667 learned_addr learned my addr 172.21.15.73:0/528281667 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f47109de640 1 -- 172.21.15.73:0/528281667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c19be20 con 0x7f470c107850 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f47109de640 1 --2- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c19b8e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f47040097f0 tx=0x7f4704030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f4709ffb640 1 -- 172.21.15.73:0/528281667 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4704042070 con 0x7f470c107850 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f4709ffb640 1 -- 172.21.15.73:0/528281667 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4704032ca0 con 0x7f470c107850 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470c19c0b0 con 0x7f470c107850 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.937+0000 7f4709ffb640 1 -- 172.21.15.73:0/528281667 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4704037040 con 0x7f470c107850 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.938+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470c19eda0 con 0x7f470c107850 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.938+0000 7f4709ffb640 1 -- 172.21.15.73:0/528281667 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4704045070 con 0x7f470c107850 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.939+0000 7f4709ffb640 1 --2- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f46f8038fc0 0x7f46f803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.939+0000 7f4709ffb640 1 -- 172.21.15.73:0/528281667 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f470406bee0 con 0x7f470c107850 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.939+0000 7f470bfff640 1 --2- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f46f8038fc0 0x7f46f803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.939+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470c10bf80 con 0x7f470c107850 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.939+0000 7f470bfff640 1 --2- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f46f8038fc0 0x7f46f803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00ad30 tx=0x7f46fc0093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:25.944+0000 7f4709ffb640 1 -- 172.21.15.73:0/528281667 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f470409b1b0 con 0x7f470c107850 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.112+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f470c104310 con 0x7f46f8038fc0 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.351+0000 7f4709ffb640 1 -- 172.21.15.73:0/528281667 <== mgr.14118 v2:172.21.15.73:6800/142266274 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f470c104310 con 0x7f46f8038fc0 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.353+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f46f8038fc0 msgr2=0x7f46f803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.353+0000 7f4712c42640 1 --2- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f46f8038fc0 0x7f46f803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00ad30 tx=0x7f46fc0093f0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.353+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 msgr2=0x7f470c19b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.353+0000 7f4712c42640 1 --2- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c19b8e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f47040097f0 tx=0x7f4704030ec0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.353+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 shutdown_connections 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.353+0000 7f4712c42640 1 --2- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f46f8038fc0 0x7f46f803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.937 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.353+0000 7f4712c42640 1 --2- 172.21.15.73:0/528281667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c107850 0x7f470c19b8e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.938 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.353+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 >> 172.21.15.73:0/528281667 conn(0x7f470c102fc0 msgr2=0x7f470c103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:26.938 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.354+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 shutdown_connections 2024-09-10T07:40:26.938 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:26.354+0000 7f4712c42640 1 -- 172.21.15.73:0/528281667 wait complete. 2024-09-10T07:40:27.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:27 smithi073 ceph-mon[30850]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:27.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:27 smithi073 ceph-mon[30850]: Generating ssh key... 2024-09-10T07:40:28.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL6tzUA0bnFMmDWBcX9X05GJepNsYkRtz1mKyS/wWbo4hH7pYN2NucJUonA6oZYtKJWBkePpGiDr+2RehRggST4XR0705p4sxTA3GV1EzpILRQHvGeArVbMxUWFgN4q/jTy6/JLQa4vfIfH7GukiZBSMsmPi5KYFM+p3zLxtPPAxH0GvD0SXRYoeSwjafQRobmelmZ2QDpk9DLO5qVol+hxpppPPp2T/uc6lp6zOJ9myno/D91UT2ccMQqdgEb8/UfHw1vnEvXA2iHek4DqLbFxuvLcigsXn1lI/WZEG01PjuuH5Og3IJPiQP/dSsbtPAO5awV7D/US2wZ66Qd+djmdwp766l9vv2CaOwv+fRMOiivj5Xl8JTghcqTWd5G3yURs/dt3+Sti7zjfXbZwmweMiTJ25kzqdLvVYWJrx12YaZEAN896tgRQsEBZcdi3T12UhR7QtShyPTueWbszsJpKVbYOrqRCP0NhHIDBSCQtnqmVTUomi/G3/JG2ySsy+0= ceph-c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:28.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.280+0000 7fd5eef96640 1 Processor -- start 2024-09-10T07:40:28.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.280+0000 7fd5eef96640 1 -- start start 2024-09-10T07:40:28.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.280+0000 7fd5eef96640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e8106b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.280+0000 7fd5eef96640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e8107110 con 0x7fd5e8106740 2024-09-10T07:40:28.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.280+0000 7fd5ecd32640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e8106b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.280+0000 7fd5ecd32640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e8106b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37004/0 (socket says 172.21.15.73:37004) 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.280+0000 7fd5ecd32640 1 -- 172.21.15.73:0/307334550 learned_addr learned my addr 172.21.15.73:0/307334550 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.280+0000 7fd5ecd32640 1 -- 172.21.15.73:0/307334550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e8107940 con 0x7fd5e8106740 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.281+0000 7fd5ecd32640 1 --2- 172.21.15.73:0/307334550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e8106b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009820 tx=0x7fd5dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595fedd26c6ed89f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.281+0000 7fd5e77fe640 1 -- 172.21.15.73:0/307334550 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5dc037070 con 0x7fd5e8106740 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.281+0000 7fd5e77fe640 1 -- 172.21.15.73:0/307334550 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5dc032900 con 0x7fd5e8106740 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.281+0000 7fd5e77fe640 1 -- 172.21.15.73:0/307334550 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5dc030850 con 0x7fd5e8106740 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 -- 172.21.15.73:0/307334550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 msgr2=0x7fd5e8106b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 --2- 172.21.15.73:0/307334550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e8106b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009820 tx=0x7fd5dc02a270 comp rx=0 tx=0).stop 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 -- 172.21.15.73:0/307334550 shutdown_connections 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 --2- 172.21.15.73:0/307334550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e8106b40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 -- 172.21.15.73:0/307334550 >> 172.21.15.73:0/307334550 conn(0x7fd5e8101ed0 msgr2=0x7fd5e8104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 -- 172.21.15.73:0/307334550 shutdown_connections 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 -- 172.21.15.73:0/307334550 wait complete. 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 Processor -- start 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 -- start start 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.282+0000 7fd5eef96640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e810acf0 con 0x7fd5e8106740 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5ecd32640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5ecd32640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37018/0 (socket says 172.21.15.73:37018) 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5ecd32640 1 -- 172.21.15.73:0/2941853005 learned_addr learned my addr 172.21.15.73:0/2941853005 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5ecd32640 1 -- 172.21.15.73:0/2941853005 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e819be20 con 0x7fd5e8106740 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5ecd32640 1 --2- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e819b8e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009940 tx=0x7fd5dc0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5e5ffb640 1 -- 172.21.15.73:0/2941853005 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5dc042070 con 0x7fd5e8106740 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e819c0b0 con 0x7fd5e8106740 2024-09-10T07:40:28.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5e5ffb640 1 -- 172.21.15.73:0/2941853005 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5dc032be0 con 0x7fd5e8106740 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5e5ffb640 1 -- 172.21.15.73:0/2941853005 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5dc037040 con 0x7fd5e8106740 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.283+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e819eda0 con 0x7fd5e8106740 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.284+0000 7fd5e5ffb640 1 -- 172.21.15.73:0/2941853005 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd5dc045070 con 0x7fd5e8106740 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.284+0000 7fd5e5ffb640 1 --2- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fd5d8038f70 0x7fd5d803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.284+0000 7fd5e5ffb640 1 -- 172.21.15.73:0/2941853005 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd5dc06bef0 con 0x7fd5e8106740 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.284+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e810ae70 con 0x7fd5e8106740 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.284+0000 7fd5e7fff640 1 --2- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fd5d8038f70 0x7fd5d803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.285+0000 7fd5e7fff640 1 --2- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fd5d8038f70 0x7fd5d803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40098c0 tx=0x7fd5d4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.289+0000 7fd5e5ffb640 1 -- 172.21.15.73:0/2941853005 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5dc032d90 con 0x7fd5e8106740 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.458+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fd5e8103200 con 0x7fd5d8038f70 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.459+0000 7fd5e5ffb640 1 -- 172.21.15.73:0/2941853005 <== mgr.14118 v2:172.21.15.73:6800/142266274 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fd5e8103200 con 0x7fd5d8038f70 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fd5d8038f70 msgr2=0x7fd5d803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 --2- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fd5d8038f70 0x7fd5d803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40098c0 tx=0x7fd5d4006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 msgr2=0x7fd5e819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 --2- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e819b8e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009940 tx=0x7fd5dc0326e0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 shutdown_connections 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 --2- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7fd5d8038f70 0x7fd5d803b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 --2- 172.21.15.73:0/2941853005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5e8106740 0x7fd5e819b8e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 >> 172.21.15.73:0/2941853005 conn(0x7fd5e8101ed0 msgr2=0x7fd5e8102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 shutdown_connections 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:27.461+0000 7fd5eef96640 1 -- 172.21.15.73:0/2941853005 wait complete. 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T07:40:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T07:40:28.012 INFO:teuthology.orchestra.run.smithi073.stdout:Adding host smithi073... 2024-09-10T07:40:28.832 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:28 smithi073 ceph-mon[30850]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:29.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:29 smithi073 ceph-mon[30850]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "addr": "172.21.15.73", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:30.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:30 smithi073 ceph-mon[30850]: Deploying cephadm binary to smithi073 2024-09-10T07:40:32.406 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Added host 'smithi073' with addr '172.21.15.73' 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.389+0000 7f2bea4d0640 1 Processor -- start 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.389+0000 7f2bea4d0640 1 -- start start 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.390+0000 7f2bea4d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be4106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.390+0000 7f2bea4d0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2be41070e0 con 0x7f2be4106710 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.390+0000 7f2be3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be4106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.390+0000 7f2be3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be4106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37020/0 (socket says 172.21.15.73:37020) 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.390+0000 7f2be3fff640 1 -- 172.21.15.73:0/4119839790 learned_addr learned my addr 172.21.15.73:0/4119839790 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.390+0000 7f2be3fff640 1 -- 172.21.15.73:0/4119839790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be4107910 con 0x7f2be4106710 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.391+0000 7f2be3fff640 1 --2- 172.21.15.73:0/4119839790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be4106b10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009820 tx=0x7f2bd402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5988c54edea436 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.391+0000 7f2be37fe640 1 -- 172.21.15.73:0/4119839790 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bd4037070 con 0x7f2be4106710 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.391+0000 7f2be37fe640 1 -- 172.21.15.73:0/4119839790 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bd4032900 con 0x7f2be4106710 2024-09-10T07:40:32.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.391+0000 7f2be37fe640 1 -- 172.21.15.73:0/4119839790 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bd4030850 con 0x7f2be4106710 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.392+0000 7f2bea4d0640 1 -- 172.21.15.73:0/4119839790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 msgr2=0x7f2be4106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.392+0000 7f2bea4d0640 1 --2- 172.21.15.73:0/4119839790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be4106b10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009820 tx=0x7f2bd402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.392+0000 7f2bea4d0640 1 -- 172.21.15.73:0/4119839790 shutdown_connections 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.392+0000 7f2bea4d0640 1 --2- 172.21.15.73:0/4119839790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be4106b10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.392+0000 7f2bea4d0640 1 -- 172.21.15.73:0/4119839790 >> 172.21.15.73:0/4119839790 conn(0x7f2be4101e80 msgr2=0x7f2be41042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.392+0000 7f2bea4d0640 1 -- 172.21.15.73:0/4119839790 shutdown_connections 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.392+0000 7f2bea4d0640 1 -- 172.21.15.73:0/4119839790 wait complete. 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.392+0000 7f2bea4d0640 1 Processor -- start 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2bea4d0640 1 -- start start 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2bea4d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:32.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2bea4d0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2be410acc0 con 0x7f2be4106710 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2be3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2be3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be419a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37024/0 (socket says 172.21.15.73:37024) 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2be3fff640 1 -- 172.21.15.73:0/1916514793 learned_addr learned my addr 172.21.15.73:0/1916514793 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2be3fff640 1 -- 172.21.15.73:0/1916514793 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be419acc0 con 0x7f2be4106710 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2be3fff640 1 --2- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be419a780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009940 tx=0x7f2bd4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2be1ffb640 1 -- 172.21.15.73:0/1916514793 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bd4042070 con 0x7f2be4106710 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2be1ffb640 1 -- 172.21.15.73:0/1916514793 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bd40308c0 con 0x7f2be4106710 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2be1ffb640 1 -- 172.21.15.73:0/1916514793 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bd4037040 con 0x7f2be4106710 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be419af50 con 0x7f2be4106710 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.393+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be419dc40 con 0x7f2be4106710 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.394+0000 7f2be1ffb640 1 -- 172.21.15.73:0/1916514793 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2bd4045070 con 0x7f2be4106710 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.394+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be410ae40 con 0x7f2be4106710 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.394+0000 7f2be1ffb640 1 --2- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2bd0038fc0 0x7f2bd003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:32.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.394+0000 7f2be1ffb640 1 -- 172.21.15.73:0/1916514793 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2bd406bff0 con 0x7f2be4106710 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.395+0000 7f2bdbfff640 1 --2- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2bd0038fc0 0x7f2bd003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.395+0000 7f2bdbfff640 1 --2- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2bd0038fc0 0x7f2bd003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098c0 tx=0x7f2bcc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.399+0000 7f2be1ffb640 1 -- 172.21.15.73:0/1916514793 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2bd404b170 con 0x7f2be4106710 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:28.566+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi073", "addr": "172.21.15.73", "target": ["mon-mgr", ""]}) -- 0x7f2be4103160 con 0x7f2bd0038fc0 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.781+0000 7f2be1ffb640 1 -- 172.21.15.73:0/1916514793 <== mgr.14118 v2:172.21.15.73:6800/142266274 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f2be4103160 con 0x7f2bd0038fc0 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2bd0038fc0 msgr2=0x7f2bd003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 --2- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2bd0038fc0 0x7f2bd003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098c0 tx=0x7f2bcc006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 msgr2=0x7f2be419a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 --2- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be419a780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009940 tx=0x7f2bd4032ce0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 shutdown_connections 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 --2- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2bd0038fc0 0x7f2bd003b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 --2- 172.21.15.73:0/1916514793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2be4106710 0x7f2be419a780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 >> 172.21.15.73:0/1916514793 conn(0x7f2be4101e80 msgr2=0x7f2be4102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:32.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 shutdown_connections 2024-09-10T07:40:32.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:31.784+0000 7f2bea4d0640 1 -- 172.21.15.73:0/1916514793 wait complete. 2024-09-10T07:40:32.411 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying unmanaged mon service... 2024-09-10T07:40:32.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:32 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:32.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:32 smithi073 ceph-mon[30850]: Added host smithi073 2024-09-10T07:40:32.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:32 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:40:33.916 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.784+0000 7f64dea11640 1 Processor -- start 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.784+0000 7f64dea11640 1 -- start start 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.784+0000 7f64dea11640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d8107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.784+0000 7f64dea11640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f64d8108220 con 0x7f64d8107850 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.784+0000 7f64d7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d8107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.784+0000 7f64d7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d8107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55416/0 (socket says 172.21.15.73:55416) 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.784+0000 7f64d7fff640 1 -- 172.21.15.73:0/995811052 learned_addr learned my addr 172.21.15.73:0/995811052 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.785+0000 7f64d7fff640 1 -- 172.21.15.73:0/995811052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d8108a50 con 0x7f64d8107850 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.785+0000 7f64d7fff640 1 --2- 172.21.15.73:0/995811052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d8107c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009820 tx=0x7f64c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fd37339073b1b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.785+0000 7f64d6ffd640 1 -- 172.21.15.73:0/995811052 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64c8037070 con 0x7f64d8107850 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.785+0000 7f64d6ffd640 1 -- 172.21.15.73:0/995811052 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64c8032900 con 0x7f64d8107850 2024-09-10T07:40:33.917 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.785+0000 7f64d6ffd640 1 -- 172.21.15.73:0/995811052 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64c8030850 con 0x7f64d8107850 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.786+0000 7f64dea11640 1 -- 172.21.15.73:0/995811052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 msgr2=0x7f64d8107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.786+0000 7f64dea11640 1 --2- 172.21.15.73:0/995811052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d8107c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009820 tx=0x7f64c802a270 comp rx=0 tx=0).stop 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.786+0000 7f64dea11640 1 -- 172.21.15.73:0/995811052 shutdown_connections 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.786+0000 7f64dea11640 1 --2- 172.21.15.73:0/995811052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d8107c50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.786+0000 7f64dea11640 1 -- 172.21.15.73:0/995811052 >> 172.21.15.73:0/995811052 conn(0x7f64d8102fc0 msgr2=0x7f64d8105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.786+0000 7f64dea11640 1 -- 172.21.15.73:0/995811052 shutdown_connections 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.786+0000 7f64dea11640 1 -- 172.21.15.73:0/995811052 wait complete. 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.787+0000 7f64dea11640 1 Processor -- start 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.787+0000 7f64dea11640 1 -- start start 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.787+0000 7f64dea11640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.787+0000 7f64dea11640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f64d810be00 con 0x7f64d8107850 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.787+0000 7f64d7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.787+0000 7f64d7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55430/0 (socket says 172.21.15.73:55430) 2024-09-10T07:40:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.787+0000 7f64d7fff640 1 -- 172.21.15.73:0/602636188 learned_addr learned my addr 172.21.15.73:0/602636188 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.787+0000 7f64d7fff640 1 -- 172.21.15.73:0/602636188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d819be20 con 0x7f64d8107850 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.788+0000 7f64d7fff640 1 --2- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d819b8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009940 tx=0x7f64c80326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.788+0000 7f64d57fa640 1 -- 172.21.15.73:0/602636188 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64c8042070 con 0x7f64d8107850 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.788+0000 7f64d57fa640 1 -- 172.21.15.73:0/602636188 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64c8032be0 con 0x7f64d8107850 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.788+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d819c0b0 con 0x7f64d8107850 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.788+0000 7f64d57fa640 1 -- 172.21.15.73:0/602636188 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64c8037040 con 0x7f64d8107850 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.788+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d819eda0 con 0x7f64d8107850 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.789+0000 7f64d57fa640 1 -- 172.21.15.73:0/602636188 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f64c8045070 con 0x7f64d8107850 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.789+0000 7f64d57fa640 1 --2- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f64c0038f70 0x7f64c003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.789+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64d810bf80 con 0x7f64d8107850 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.789+0000 7f64d57fa640 1 -- 172.21.15.73:0/602636188 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f64c806bf60 con 0x7f64d8107850 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.789+0000 7f64d77fe640 1 --2- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f64c0038f70 0x7f64c003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.789+0000 7f64d77fe640 1 --2- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f64c0038f70 0x7f64c003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0098c0 tx=0x7f64cc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.794+0000 7f64d57fa640 1 -- 172.21.15.73:0/602636188 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64c8045e10 con 0x7f64d8107850 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.983+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f64d8104310 con 0x7f64c0038f70 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.987+0000 7f64d57fa640 1 -- 172.21.15.73:0/602636188 <== mgr.14118 v2:172.21.15.73:6800/142266274 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f64d8104310 con 0x7f64c0038f70 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.989+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f64c0038f70 msgr2=0x7f64c003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.989+0000 7f64dea11640 1 --2- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f64c0038f70 0x7f64c003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0098c0 tx=0x7f64cc006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.989+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 msgr2=0x7f64d819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.989+0000 7f64dea11640 1 --2- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d819b8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009940 tx=0x7f64c80326e0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.990+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 shutdown_connections 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.990+0000 7f64dea11640 1 --2- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f64c0038f70 0x7f64c003b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.990+0000 7f64dea11640 1 --2- 172.21.15.73:0/602636188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d8107850 0x7f64d819b8e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.990+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 >> 172.21.15.73:0/602636188 conn(0x7f64d8102fc0 msgr2=0x7f64d8103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.990+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 shutdown_connections 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:32.990+0000 7f64dea11640 1 -- 172.21.15.73:0/602636188 wait complete. 2024-09-10T07:40:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying unmanaged mgr service... 2024-09-10T07:40:34.219 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:33 smithi073 ceph-mon[30850]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:34.219 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:33 smithi073 ceph-mon[30850]: Saving service mon spec with placement count:5 2024-09-10T07:40:34.220 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:33 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:35.090 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T07:40:35.090 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.299+0000 7f289a479640 1 Processor -- start 2024-09-10T07:40:35.090 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.299+0000 7f289a479640 1 -- start start 2024-09-10T07:40:35.090 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.300+0000 7f289a479640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f289410a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:35.090 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.300+0000 7f289a479640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f289407c680 con 0x7f2894108390 2024-09-10T07:40:35.090 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.300+0000 7f2893fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f289410a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.300+0000 7f2893fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f289410a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55442/0 (socket says 172.21.15.73:55442) 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.300+0000 7f2893fff640 1 -- 172.21.15.73:0/1004127059 learned_addr learned my addr 172.21.15.73:0/1004127059 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.300+0000 7f2893fff640 1 -- 172.21.15.73:0/1004127059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289410acc0 con 0x7f2894108390 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.301+0000 7f2893fff640 1 --2- 172.21.15.73:0/1004127059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f289410a780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2884009820 tx=0x7f288402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f71ba6b897dd30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.301+0000 7f28937fe640 1 -- 172.21.15.73:0/1004127059 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2884037070 con 0x7f2894108390 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.301+0000 7f28937fe640 1 -- 172.21.15.73:0/1004127059 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2884032900 con 0x7f2894108390 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.301+0000 7f28937fe640 1 -- 172.21.15.73:0/1004127059 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2884030850 con 0x7f2894108390 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 -- 172.21.15.73:0/1004127059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 msgr2=0x7f289410a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 --2- 172.21.15.73:0/1004127059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f289410a780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2884009820 tx=0x7f288402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 -- 172.21.15.73:0/1004127059 shutdown_connections 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 --2- 172.21.15.73:0/1004127059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f289410a780 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 -- 172.21.15.73:0/1004127059 >> 172.21.15.73:0/1004127059 conn(0x7f2894101ed0 msgr2=0x7f2894104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 -- 172.21.15.73:0/1004127059 shutdown_connections 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 -- 172.21.15.73:0/1004127059 wait complete. 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 Processor -- start 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 -- start start 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f2894107c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.302+0000 7f289a479640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f289410bc40 con 0x7f2894108390 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f2893fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f2894107c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f2893fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f2894107c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55456/0 (socket says 172.21.15.73:55456) 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f2893fff640 1 -- 172.21.15.73:0/2399978239 learned_addr learned my addr 172.21.15.73:0/2399978239 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f2893fff640 1 -- 172.21.15.73:0/2399978239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2894108150 con 0x7f2894108390 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f2893fff640 1 --2- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f2894107c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2884031000 tx=0x7f28840326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f2891ffb640 1 -- 172.21.15.73:0/2399978239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2884042070 con 0x7f2894108390 2024-09-10T07:40:35.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f2891ffb640 1 -- 172.21.15.73:0/2399978239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2884032be0 con 0x7f2894108390 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2894106340 con 0x7f2894108390 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f2891ffb640 1 -- 172.21.15.73:0/2399978239 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2884037040 con 0x7f2894108390 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.303+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2894106880 con 0x7f2894108390 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.304+0000 7f2891ffb640 1 -- 172.21.15.73:0/2399978239 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2884045070 con 0x7f2894108390 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.304+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28941087f0 con 0x7f2894108390 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.304+0000 7f2891ffb640 1 --2- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2880038f70 0x7f288003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.304+0000 7f2891ffb640 1 -- 172.21.15.73:0/2399978239 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f288406c0a0 con 0x7f2894108390 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.304+0000 7f288bfff640 1 --2- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2880038f70 0x7f288003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.305+0000 7f288bfff640 1 --2- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2880038f70 0x7f288003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f287c0098c0 tx=0x7f287c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.309+0000 7f2891ffb640 1 -- 172.21.15.73:0/2399978239 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f288403d430 con 0x7f2894108390 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.498+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2894107130 con 0x7f2880038f70 2024-09-10T07:40:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.503+0000 7f2891ffb640 1 -- 172.21.15.73:0/2399978239 <== mgr.14118 v2:172.21.15.73:6800/142266274 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2894107130 con 0x7f2880038f70 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.504+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2880038f70 msgr2=0x7f288003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.504+0000 7f289a479640 1 --2- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2880038f70 0x7f288003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f287c0098c0 tx=0x7f287c006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.505+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 msgr2=0x7f2894107c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.505+0000 7f289a479640 1 --2- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f2894107c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2884031000 tx=0x7f28840326e0 comp rx=0 tx=0).stop 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.505+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 shutdown_connections 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.505+0000 7f289a479640 1 --2- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2880038f70 0x7f288003b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.505+0000 7f289a479640 1 --2- 172.21.15.73:0/2399978239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2894108390 0x7f2894107c10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.505+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 >> 172.21.15.73:0/2399978239 conn(0x7f2894101ed0 msgr2=0x7f2894102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.505+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 shutdown_connections 2024-09-10T07:40:35.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:34.505+0000 7f289a479640 1 -- 172.21.15.73:0/2399978239 wait complete. 2024-09-10T07:40:35.642 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:35 smithi073 ceph-mon[30850]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:35.642 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:35 smithi073 ceph-mon[30850]: Saving service mgr spec with placement count:2 2024-09-10T07:40:35.643 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:35 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:36.886 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:36 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/240614318' entity='client.admin' 2024-09-10T07:40:36.886 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:36 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:36.894 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.473+0000 7f09d6171640 1 Processor -- start 2024-09-10T07:40:36.894 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.473+0000 7f09d6171640 1 -- start start 2024-09-10T07:40:36.894 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.474+0000 7f09d6171640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d0106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:36.894 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.474+0000 7f09d6171640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f09d01070e0 con 0x7f09d0106710 2024-09-10T07:40:36.894 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.474+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d0106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:36.894 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.474+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d0106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55470/0 (socket says 172.21.15.73:55470) 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.474+0000 7f09cf7fe640 1 -- 172.21.15.73:0/3319796888 learned_addr learned my addr 172.21.15.73:0/3319796888 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.474+0000 7f09cf7fe640 1 -- 172.21.15.73:0/3319796888 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d0107910 con 0x7f09d0106710 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09cf7fe640 1 --2- 172.21.15.73:0/3319796888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d0106b10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009820 tx=0x7f09c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b576ea884e6837e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09ce7fc640 1 -- 172.21.15.73:0/3319796888 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c0037070 con 0x7f09d0106710 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09ce7fc640 1 -- 172.21.15.73:0/3319796888 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09c0032900 con 0x7f09d0106710 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09ce7fc640 1 -- 172.21.15.73:0/3319796888 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c0030850 con 0x7f09d0106710 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09d6171640 1 -- 172.21.15.73:0/3319796888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 msgr2=0x7f09d0106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09d6171640 1 --2- 172.21.15.73:0/3319796888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d0106b10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009820 tx=0x7f09c002a270 comp rx=0 tx=0).stop 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09d6171640 1 -- 172.21.15.73:0/3319796888 shutdown_connections 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09d6171640 1 --2- 172.21.15.73:0/3319796888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d0106b10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09d6171640 1 -- 172.21.15.73:0/3319796888 >> 172.21.15.73:0/3319796888 conn(0x7f09d0101e80 msgr2=0x7f09d01042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.475+0000 7f09d6171640 1 -- 172.21.15.73:0/3319796888 shutdown_connections 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.476+0000 7f09d6171640 1 -- 172.21.15.73:0/3319796888 wait complete. 2024-09-10T07:40:36.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.476+0000 7f09d6171640 1 Processor -- start 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.476+0000 7f09d6171640 1 -- start start 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.476+0000 7f09d6171640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d019b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.476+0000 7f09d6171640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f09d010acc0 con 0x7f09d0106710 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.476+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d019b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.476+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d019b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55474/0 (socket says 172.21.15.73:55474) 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.477+0000 7f09cf7fe640 1 -- 172.21.15.73:0/240614318 learned_addr learned my addr 172.21.15.73:0/240614318 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.477+0000 7f09cf7fe640 1 -- 172.21.15.73:0/240614318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d019bdc0 con 0x7f09d0106710 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.477+0000 7f09cf7fe640 1 --2- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d019b880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09c00097f0 tx=0x7f09c0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.477+0000 7f09ccff9640 1 -- 172.21.15.73:0/240614318 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c0037040 con 0x7f09d0106710 2024-09-10T07:40:36.896 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.477+0000 7f09ccff9640 1 -- 172.21.15.73:0/240614318 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09c0040070 con 0x7f09d0106710 2024-09-10T07:40:36.897 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.477+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d019c050 con 0x7f09d0106710 2024-09-10T07:40:36.897 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.477+0000 7f09ccff9640 1 -- 172.21.15.73:0/240614318 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c003a390 con 0x7f09d0106710 2024-09-10T07:40:36.897 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.477+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d019ed40 con 0x7f09d0106710 2024-09-10T07:40:36.897 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.478+0000 7f09ccff9640 1 -- 172.21.15.73:0/240614318 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f09c003a630 con 0x7f09d0106710 2024-09-10T07:40:36.897 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.478+0000 7f09ccff9640 1 --2- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f09b8038f70 0x7f09b803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:36.897 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.478+0000 7f09ccff9640 1 -- 172.21.15.73:0/240614318 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f09c006c4d0 con 0x7f09d0106710 2024-09-10T07:40:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.478+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d010ae40 con 0x7f09d0106710 2024-09-10T07:40:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.478+0000 7f09ceffd640 1 --2- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f09b8038f70 0x7f09b803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.479+0000 7f09ceffd640 1 --2- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f09b8038f70 0x7f09b803b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f09c40098c0 tx=0x7f09c4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.483+0000 7f09ccff9640 1 -- 172.21.15.73:0/240614318 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09c004a200 con 0x7f09d0106710 2024-09-10T07:40:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.652+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f09d002d950 con 0x7f09d0106710 2024-09-10T07:40:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.655+0000 7f09ccff9640 1 -- 172.21.15.73:0/240614318 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f09c002ee80 con 0x7f09d0106710 2024-09-10T07:40:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f09b8038f70 msgr2=0x7f09b803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 --2- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f09b8038f70 0x7f09b803b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f09c40098c0 tx=0x7f09c4006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 msgr2=0x7f09d019b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:36.899 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 --2- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d019b880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09c00097f0 tx=0x7f09c0030d80 comp rx=0 tx=0).stop 2024-09-10T07:40:36.899 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 shutdown_connections 2024-09-10T07:40:36.899 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 --2- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f09b8038f70 0x7f09b803b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:36.899 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 --2- 172.21.15.73:0/240614318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09d0106710 0x7f09d019b880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:36.899 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 >> 172.21.15.73:0/240614318 conn(0x7f09d0101e80 msgr2=0x7f09d0102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:36.899 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 shutdown_connections 2024-09-10T07:40:36.899 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:35.657+0000 7f09d6171640 1 -- 172.21.15.73:0/240614318 wait complete. 2024-09-10T07:40:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:37 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:37 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2064742476' entity='client.admin' 2024-09-10T07:40:38.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.345+0000 7fa01aee7640 1 Processor -- start 2024-09-10T07:40:38.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.345+0000 7fa01aee7640 1 -- start start 2024-09-10T07:40:38.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.345+0000 7fa01aee7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa014107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:38.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.345+0000 7fa01aee7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa014108220 con 0x7fa014107850 2024-09-10T07:40:38.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.345+0000 7fa018c83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa014107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:38.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.346+0000 7fa018c83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa014107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55488/0 (socket says 172.21.15.73:55488) 2024-09-10T07:40:38.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.346+0000 7fa018c83640 1 -- 172.21.15.73:0/2085021589 learned_addr learned my addr 172.21.15.73:0/2085021589 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:38.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.346+0000 7fa018c83640 1 -- 172.21.15.73:0/2085021589 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa014108a50 con 0x7fa014107850 2024-09-10T07:40:38.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.346+0000 7fa018c83640 1 --2- 172.21.15.73:0/2085021589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa014107c50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa004009820 tx=0x7fa00402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8236f868c50398d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa0137fe640 1 -- 172.21.15.73:0/2085021589 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004037070 con 0x7fa014107850 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa0137fe640 1 -- 172.21.15.73:0/2085021589 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa004032920 con 0x7fa014107850 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa0137fe640 1 -- 172.21.15.73:0/2085021589 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004030810 con 0x7fa014107850 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa01aee7640 1 -- 172.21.15.73:0/2085021589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 msgr2=0x7fa014107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa01aee7640 1 --2- 172.21.15.73:0/2085021589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa014107c50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa004009820 tx=0x7fa00402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa01aee7640 1 -- 172.21.15.73:0/2085021589 shutdown_connections 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa01aee7640 1 --2- 172.21.15.73:0/2085021589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa014107c50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa01aee7640 1 -- 172.21.15.73:0/2085021589 >> 172.21.15.73:0/2085021589 conn(0x7fa014102fc0 msgr2=0x7fa014105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa01aee7640 1 -- 172.21.15.73:0/2085021589 shutdown_connections 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.347+0000 7fa01aee7640 1 -- 172.21.15.73:0/2085021589 wait complete. 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.348+0000 7fa01aee7640 1 Processor -- start 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.348+0000 7fa01aee7640 1 -- start start 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.348+0000 7fa01aee7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa01407e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:38.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.348+0000 7fa01aee7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa01410be00 con 0x7fa014107850 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.348+0000 7fa018c83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa01407e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.348+0000 7fa018c83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa01407e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55500/0 (socket says 172.21.15.73:55500) 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.348+0000 7fa018c83640 1 -- 172.21.15.73:0/2064742476 learned_addr learned my addr 172.21.15.73:0/2064742476 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.348+0000 7fa018c83640 1 -- 172.21.15.73:0/2064742476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01407e960 con 0x7fa014107850 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.348+0000 7fa018c83640 1 --2- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa01407e420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa004030560 tx=0x7fa004032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.349+0000 7fa011ffb640 1 -- 172.21.15.73:0/2064742476 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004037040 con 0x7fa014107850 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.349+0000 7fa011ffb640 1 -- 172.21.15.73:0/2064742476 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa004040070 con 0x7fa014107850 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.349+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01407cb50 con 0x7fa014107850 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.349+0000 7fa011ffb640 1 -- 172.21.15.73:0/2064742476 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00403a6d0 con 0x7fa014107850 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.349+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa01407d090 con 0x7fa014107850 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.350+0000 7fa011ffb640 1 -- 172.21.15.73:0/2064742476 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa00403a940 con 0x7fa014107850 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.350+0000 7fa011ffb640 1 --2- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f9ffc038f70 0x7f9ffc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.350+0000 7fa011ffb640 1 -- 172.21.15.73:0/2064742476 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa00406c720 con 0x7fa014107850 2024-09-10T07:40:38.356 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.350+0000 7fa013fff640 1 --2- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f9ffc038f70 0x7f9ffc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.350+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa01410bf80 con 0x7fa014107850 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.351+0000 7fa013fff640 1 --2- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f9ffc038f70 0x7f9ffc03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa0080098c0 tx=0x7fa008006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.355+0000 7fa011ffb640 1 -- 172.21.15.73:0/2064742476 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa004044c70 con 0x7fa014107850 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.534+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa014107cd0 con 0x7fa014107850 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.536+0000 7fa011ffb640 1 -- 172.21.15.73:0/2064742476 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa0040328f0 con 0x7fa014107850 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.538+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f9ffc038f70 msgr2=0x7f9ffc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.538+0000 7fa01aee7640 1 --2- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f9ffc038f70 0x7f9ffc03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa0080098c0 tx=0x7fa008006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.538+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 msgr2=0x7fa01407e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.538+0000 7fa01aee7640 1 --2- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa01407e420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa004030560 tx=0x7fa004032670 comp rx=0 tx=0).stop 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.539+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 shutdown_connections 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.539+0000 7fa01aee7640 1 --2- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f9ffc038f70 0x7f9ffc03b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.539+0000 7fa01aee7640 1 --2- 172.21.15.73:0/2064742476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa014107850 0x7fa01407e420 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:38.357 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.539+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 >> 172.21.15.73:0/2064742476 conn(0x7fa014102fc0 msgr2=0x7fa014103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:38.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.539+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 shutdown_connections 2024-09-10T07:40:38.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:37.539+0000 7fa01aee7640 1 -- 172.21.15.73:0/2064742476 wait complete. 2024-09-10T07:40:38.358 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling the dashboard module... 2024-09-10T07:40:39.727 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:39 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:39.727 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:39 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3640620108' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T07:40:39.727 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:39 smithi073 ceph-mon[30850]: from='mgr.14118 172.21.15.73:0/2189795773' entity='mgr.x' 2024-09-10T07:40:40.041 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: ignoring --setuser ceph since I am not root 2024-09-10T07:40:40.042 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: ignoring --setgroup ceph since I am not root 2024-09-10T07:40:40.042 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:39.828+0000 7f7e53d8c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:40:40.042 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:39.886+0000 7f7e53d8c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:40:40.042 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:40.041+0000 7f7e53d8c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:40:40.298 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:40.109+0000 7f7e53d8c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:40:40.298 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:40.257+0000 7f7e53d8c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.243+0000 7f297ead8640 1 Processor -- start 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.244+0000 7f297ead8640 1 -- start start 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.244+0000 7f297ead8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f29781064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.244+0000 7f297ead8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f297807be90 con 0x7f29781060b0 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.244+0000 7f297c874640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f29781064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.244+0000 7f297c874640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f29781064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55502/0 (socket says 172.21.15.73:55502) 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.244+0000 7f297c874640 1 -- 172.21.15.73:0/3848495094 learned_addr learned my addr 172.21.15.73:0/3848495094 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.244+0000 7f297c874640 1 -- 172.21.15.73:0/3848495094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29781069f0 con 0x7f29781060b0 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.245+0000 7f297c874640 1 --2- 172.21.15.73:0/3848495094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f29781064b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f296c009820 tx=0x7f296c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447829abc8101ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.245+0000 7f29777fe640 1 -- 172.21.15.73:0/3848495094 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c037070 con 0x7f29781060b0 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.245+0000 7f29777fe640 1 -- 172.21.15.73:0/3848495094 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f296c032920 con 0x7f29781060b0 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.245+0000 7f29777fe640 1 -- 172.21.15.73:0/3848495094 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c030810 con 0x7f29781060b0 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.246+0000 7f297ead8640 1 -- 172.21.15.73:0/3848495094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 msgr2=0x7f29781064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.246+0000 7f297ead8640 1 --2- 172.21.15.73:0/3848495094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f29781064b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f296c009820 tx=0x7f296c02a270 comp rx=0 tx=0).stop 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.246+0000 7f297ead8640 1 -- 172.21.15.73:0/3848495094 shutdown_connections 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.246+0000 7f297ead8640 1 --2- 172.21.15.73:0/3848495094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f29781064b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.246+0000 7f297ead8640 1 -- 172.21.15.73:0/3848495094 >> 172.21.15.73:0/3848495094 conn(0x7f2978101e80 msgr2=0x7f29781042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.246+0000 7f297ead8640 1 -- 172.21.15.73:0/3848495094 shutdown_connections 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.246+0000 7f297ead8640 1 -- 172.21.15.73:0/3848495094 wait complete. 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.247+0000 7f297ead8640 1 Processor -- start 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.247+0000 7f297ead8640 1 -- start start 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.247+0000 7f297ead8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f297819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.247+0000 7f297ead8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2978107b30 con 0x7f29781060b0 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.247+0000 7f297c874640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f297819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.247+0000 7f297c874640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f297819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55512/0 (socket says 172.21.15.73:55512) 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.247+0000 7f297c874640 1 -- 172.21.15.73:0/3640620108 learned_addr learned my addr 172.21.15.73:0/3640620108 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.247+0000 7f297c874640 1 -- 172.21.15.73:0/3640620108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297819df60 con 0x7f29781060b0 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.247+0000 7f297c874640 1 --2- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f297819da20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f296c030380 tx=0x7f296c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.248+0000 7f2975ffb640 1 -- 172.21.15.73:0/3640620108 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c037040 con 0x7f29781060b0 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.248+0000 7f2975ffb640 1 -- 172.21.15.73:0/3640620108 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f296c040070 con 0x7f29781060b0 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.248+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297819e1f0 con 0x7f29781060b0 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.248+0000 7f2975ffb640 1 -- 172.21.15.73:0/3640620108 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c03a7b0 con 0x7f29781060b0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.248+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29781a0ee0 con 0x7f29781060b0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.249+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29781064b0 con 0x7f29781060b0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.249+0000 7f2975ffb640 1 -- 172.21.15.73:0/3640620108 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f296c03aa30 con 0x7f29781060b0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.249+0000 7f2975ffb640 1 --2- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2968038f70 0x7f296803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.249+0000 7f2975ffb640 1 -- 172.21.15.73:0/3640620108 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f296c06c630 con 0x7f29781060b0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.249+0000 7f2977fff640 1 --2- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2968038f70 0x7f296803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.250+0000 7f2977fff640 1 --2- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2968038f70 0x7f296803b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29640098c0 tx=0x7f2964006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.254+0000 7f2975ffb640 1 -- 172.21.15.73:0/3640620108 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f296c044c70 con 0x7f29781060b0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.476+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f2978196e90 con 0x7f29781060b0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.679+0000 7f2975ffb640 1 -- 172.21.15.73:0/3640620108 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f296c041270 con 0x7f29781060b0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.680+0000 7f2975ffb640 1 -- 172.21.15.73:0/3640620108 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f296c045980 con 0x7f29781060b0 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2968038f70 msgr2=0x7f296803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 --2- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2968038f70 0x7f296803b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29640098c0 tx=0x7f2964006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 msgr2=0x7f297819da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 --2- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f297819da20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f296c030380 tx=0x7f296c032670 comp rx=0 tx=0).stop 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 shutdown_connections 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 --2- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f2968038f70 0x7f296803b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 --2- 172.21.15.73:0/3640620108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29781060b0 0x7f297819da20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 >> 172.21.15.73:0/3640620108 conn(0x7f2978101e80 msgr2=0x7f2978191d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 shutdown_connections 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:39.682+0000 7f297ead8640 1 -- 172.21.15.73:0/3640620108 wait complete. 2024-09-10T07:40:40.625 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:40.404+0000 7f7e53d8c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:40:40.895 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:40 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3640620108' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T07:40:40.895 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:40 smithi073 ceph-mon[30850]: mgrmap e9: x(active, since 18s) 2024-09-10T07:40:40.895 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:40.728+0000 7f7e53d8c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:40:40.895 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:40.795+0000 7f7e53d8c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:40:41.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:40.993+0000 7f7e53d8c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:40:41.942 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:41 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3790987261' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T07:40:41.942 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:41.890+0000 7f7e53d8c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:40:42.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:41.959+0000 7f7e53d8c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:40:42.328 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:40:42.329 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T07:40:42.329 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T07:40:42.329 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T07:40:42.329 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T07:40:42.329 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:40:42.329 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.706+0000 7f30f3b3e640 1 Processor -- start 2024-09-10T07:40:42.329 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.706+0000 7f30f3b3e640 1 -- start start 2024-09-10T07:40:42.329 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.706+0000 7f30f3b3e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec106b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:42.330 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.706+0000 7f30f3b3e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec107160 con 0x7f30ec106790 2024-09-10T07:40:42.330 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.706+0000 7f30f18da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:42.330 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.706+0000 7f30f18da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41722/0 (socket says 172.21.15.73:41722) 2024-09-10T07:40:42.330 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.706+0000 7f30f18da640 1 -- 172.21.15.73:0/1502514981 learned_addr learned my addr 172.21.15.73:0/1502514981 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:42.330 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.707+0000 7f30f18da640 1 -- 172.21.15.73:0/1502514981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ec1078f0 con 0x7f30ec106790 2024-09-10T07:40:42.330 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.707+0000 7f30f18da640 1 --2- 172.21.15.73:0/1502514981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec106b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009820 tx=0x7f30e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125428dedd3e41ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:42.330 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.707+0000 7f30f08d8640 1 -- 172.21.15.73:0/1502514981 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30e8037070 con 0x7f30ec106790 2024-09-10T07:40:42.330 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.708+0000 7f30f08d8640 1 -- 172.21.15.73:0/1502514981 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e8032920 con 0x7f30ec106790 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.708+0000 7f30f08d8640 1 -- 172.21.15.73:0/1502514981 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30e8030810 con 0x7f30ec106790 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.708+0000 7f30f3b3e640 1 -- 172.21.15.73:0/1502514981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 msgr2=0x7f30ec106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.708+0000 7f30f3b3e640 1 --2- 172.21.15.73:0/1502514981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec106b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009820 tx=0x7f30e802a270 comp rx=0 tx=0).stop 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.709+0000 7f30f3b3e640 1 -- 172.21.15.73:0/1502514981 shutdown_connections 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.709+0000 7f30f3b3e640 1 --2- 172.21.15.73:0/1502514981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec106b90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.709+0000 7f30f3b3e640 1 -- 172.21.15.73:0/1502514981 >> 172.21.15.73:0/1502514981 conn(0x7f30ec101f60 msgr2=0x7f30ec104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.709+0000 7f30f3b3e640 1 -- 172.21.15.73:0/1502514981 shutdown_connections 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.709+0000 7f30f3b3e640 1 -- 172.21.15.73:0/1502514981 wait complete. 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.709+0000 7f30f3b3e640 1 Processor -- start 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.709+0000 7f30f3b3e640 1 -- start start 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.709+0000 7f30f3b3e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec191920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.709+0000 7f30f3b3e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec10aca0 con 0x7f30ec106790 2024-09-10T07:40:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30f18da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec191920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30f18da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec191920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41738/0 (socket says 172.21.15.73:41738) 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30f18da640 1 -- 172.21.15.73:0/3790987261 learned_addr learned my addr 172.21.15.73:0/3790987261 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30f18da640 1 -- 172.21.15.73:0/3790987261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ec191e60 con 0x7f30ec106790 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30f18da640 1 --2- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec191920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f30e8030560 tx=0x7f30e8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30e2ffd640 1 -- 172.21.15.73:0/3790987261 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30e8037040 con 0x7f30ec106790 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30e2ffd640 1 -- 172.21.15.73:0/3790987261 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e8040070 con 0x7f30ec106790 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30e2ffd640 1 -- 172.21.15.73:0/3790987261 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30e803a740 con 0x7f30ec106790 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ec190050 con 0x7f30ec106790 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.710+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ec190590 con 0x7f30ec106790 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.711+0000 7f30e2ffd640 1 -- 172.21.15.73:0/3790987261 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f30e803bb90 con 0x7f30ec106790 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.711+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ec10ae20 con 0x7f30ec106790 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.712+0000 7f30e2ffd640 1 --2- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f30d8039020 0x7f30d803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.712+0000 7f30e2ffd640 1 -- 172.21.15.73:0/3790987261 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f30e806c590 con 0x7f30ec106790 2024-09-10T07:40:42.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.712+0000 7f30f10d9640 1 -- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f30d8039020 msgr2=0x7f30d803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/142266274 2024-09-10T07:40:42.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.712+0000 7f30f10d9640 1 --2- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f30d8039020 0x7f30d803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:40:42.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.716+0000 7f30e2ffd640 1 -- 172.21.15.73:0/3790987261 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30e804a200 con 0x7f30ec106790 2024-09-10T07:40:42.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.913+0000 7f30f10d9640 1 -- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f30d8039020 msgr2=0x7f30d803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/142266274 2024-09-10T07:40:42.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.913+0000 7f30f10d9640 1 --2- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f30d8039020 0x7f30d803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:40:42.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.939+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f30ec1956f0 con 0x7f30ec106790 2024-09-10T07:40:42.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.939+0000 7f30e2ffd640 1 -- 172.21.15.73:0/3790987261 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f30e8031e80 con 0x7f30ec106790 2024-09-10T07:40:42.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.941+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f30d8039020 msgr2=0x7f30d803b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:40:42.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.941+0000 7f30f3b3e640 1 --2- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f30d8039020 0x7f30d803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.941+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 msgr2=0x7f30ec191920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.941+0000 7f30f3b3e640 1 --2- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec191920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f30e8030560 tx=0x7f30e8032670 comp rx=0 tx=0).stop 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.942+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 shutdown_connections 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.942+0000 7f30f3b3e640 1 --2- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f30d8039020 0x7f30d803b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.942+0000 7f30f3b3e640 1 --2- 172.21.15.73:0/3790987261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30ec106790 0x7f30ec191920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.942+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 >> 172.21.15.73:0/3790987261 conn(0x7f30ec101f60 msgr2=0x7f30ec102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.942+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 shutdown_connections 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:40.942+0000 7f30f3b3e640 1 -- 172.21.15.73:0/3790987261 wait complete. 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for the mgr to restart... 2024-09-10T07:40:42.334 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr epoch 9... 2024-09-10T07:40:42.948 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:42.702+0000 7f7e53d8c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:40:42.949 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:42.822+0000 7f7e53d8c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:40:43.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:42.966+0000 7f7e53d8c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:40:43.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.028+0000 7f7e53d8c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:40:43.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.177+0000 7f7e53d8c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:40:43.528 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.245+0000 7f7e53d8c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:40:43.529 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.305+0000 7f7e53d8c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:40:43.529 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.463+0000 7f7e53d8c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:40:43.529 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.528+0000 7f7e53d8c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:40:43.795 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.593+0000 7f7e53d8c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:40:43.795 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.676+0000 7f7e53d8c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:40:43.795 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.736+0000 7f7e53d8c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:40:43.795 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:43.795+0000 7f7e53d8c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:40:44.972 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:44.579+0000 7f7e53d8c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: Active manager daemon x restarted 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: Activating manager daemon x 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: mgrmap e10: x(active, starting, since 0.00319521s) 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: Manager daemon x is now available 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T07:40:45.973 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:45.648+0000 7f7db9855640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:07:40:45] ENGINE Error in HTTPServer.serve 2024-09-10T07:40:45.973 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: Traceback (most recent call last): 2024-09-10T07:40:45.973 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:40:45.973 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self._connections.run(self.expiration_interval) 2024-09-10T07:40:45.973 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self._run(expiration_interval) 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: s = self.context.wrap_socket( 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: return self.sslsocket_class._create( 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self.do_handshake() 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:40:45.974 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self._sslobj.do_handshake() 2024-09-10T07:40:45.975 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:40:45.975 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:40:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:40:46.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:40:46.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T07:40:46.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T07:40:46.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:40:46.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.742+0000 7f395a172640 1 Processor -- start 2024-09-10T07:40:46.305 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.742+0000 7f395a172640 1 -- start start 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.742+0000 7f395a172640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f3954106b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.742+0000 7f395a172640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3954107120 con 0x7f3954106750 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.742+0000 7f39537fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f3954106b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.742+0000 7f39537fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f3954106b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41742/0 (socket says 172.21.15.73:41742) 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.742+0000 7f39537fe640 1 -- 172.21.15.73:0/3074118164 learned_addr learned my addr 172.21.15.73:0/3074118164 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.742+0000 7f39537fe640 1 -- 172.21.15.73:0/3074118164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3954107950 con 0x7f3954106750 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.743+0000 7f39537fe640 1 --2- 172.21.15.73:0/3074118164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f3954106b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3944009820 tx=0x7f394402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3beac96477250b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.743+0000 7f39527fc640 1 -- 172.21.15.73:0/3074118164 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3944037070 con 0x7f3954106750 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.743+0000 7f39527fc640 1 -- 172.21.15.73:0/3074118164 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3944032920 con 0x7f3954106750 2024-09-10T07:40:46.306 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.743+0000 7f39527fc640 1 -- 172.21.15.73:0/3074118164 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3944030810 con 0x7f3954106750 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.744+0000 7f395a172640 1 -- 172.21.15.73:0/3074118164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 msgr2=0x7f3954106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.744+0000 7f395a172640 1 --2- 172.21.15.73:0/3074118164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f3954106b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3944009820 tx=0x7f394402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.744+0000 7f395a172640 1 -- 172.21.15.73:0/3074118164 shutdown_connections 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.744+0000 7f395a172640 1 --2- 172.21.15.73:0/3074118164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f3954106b50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.744+0000 7f395a172640 1 -- 172.21.15.73:0/3074118164 >> 172.21.15.73:0/3074118164 conn(0x7f3954101ea0 msgr2=0x7f3954104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.744+0000 7f395a172640 1 -- 172.21.15.73:0/3074118164 shutdown_connections 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.744+0000 7f395a172640 1 -- 172.21.15.73:0/3074118164 wait complete. 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.744+0000 7f395a172640 1 Processor -- start 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.745+0000 7f395a172640 1 -- start start 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.745+0000 7f395a172640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f395419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.745+0000 7f395a172640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f395410ad00 con 0x7f3954106750 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.745+0000 7f39537fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f395419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.745+0000 7f39537fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f395419b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41748/0 (socket says 172.21.15.73:41748) 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.745+0000 7f39537fe640 1 -- 172.21.15.73:0/946490893 learned_addr learned my addr 172.21.15.73:0/946490893 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.745+0000 7f39537fe640 1 -- 172.21.15.73:0/946490893 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395419be80 con 0x7f3954106750 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.745+0000 7f39537fe640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f395419b940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39440097f0 tx=0x7f39440327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.745+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3944037040 con 0x7f3954106750 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.746+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3944030c40 con 0x7f3954106750 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.746+0000 7f395a172640 1 -- 172.21.15.73:0/946490893 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395419c110 con 0x7f3954106750 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.746+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394403a5b0 con 0x7f3954106750 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.746+0000 7f395a172640 1 -- 172.21.15.73:0/946490893 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395419ee00 con 0x7f3954106750 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.747+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f394403a7a0 con 0x7f3954106750 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.747+0000 7f3950ff9640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 0x7f393c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.747+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 --> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f393c03bbf0 con 0x7f393c039020 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.747+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f394406c5d0 con 0x7f3954106750 2024-09-10T07:40:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.747+0000 7f3952ffd640 1 -- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 msgr2=0x7f393c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/142266274 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.747+0000 7f3952ffd640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 0x7f393c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.948+0000 7f3952ffd640 1 -- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 msgr2=0x7f393c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/142266274 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:42.948+0000 7f3952ffd640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 0x7f393c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:43.349+0000 7f3952ffd640 1 -- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 msgr2=0x7f393c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/142266274 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:43.349+0000 7f3952ffd640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 0x7f393c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:44.151+0000 7f3952ffd640 1 -- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 msgr2=0x7f393c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/142266274 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:44.151+0000 7f3952ffd640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 0x7f393c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:44.583+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f394402fd60 con 0x7f3954106750 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:44.583+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 msgr2=0x7f393c03b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:44.583+0000 7f3950ff9640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 0x7f393c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.584+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f3944044400 con 0x7f3954106750 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.585+0000 7f3950ff9640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f393c03cae0 0x7f393c03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.585+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f393c03bbf0 con 0x7f393c03cae0 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.585+0000 7f3952ffd640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f393c03cae0 0x7f393c03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.586+0000 7f3952ffd640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f393c03cae0 0x7f393c03eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3948003980 tx=0x7f39480092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.586+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f393c03bbf0 con 0x7f393c03cae0 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.593+0000 7f395a172640 1 -- 172.21.15.73:0/946490893 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f395410ae80 con 0x7f393c03cae0 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.593+0000 7f3950ff9640 1 -- 172.21.15.73:0/946490893 <== mgr.14150 v2:172.21.15.73:6800/662943870 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f395410ae80 con 0x7f393c03cae0 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.593+0000 7f395a172640 1 -- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f393c03cae0 msgr2=0x7f393c03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f393c03cae0 0x7f393c03eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3948003980 tx=0x7f39480092b0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 -- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 msgr2=0x7f395419b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f395419b940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39440097f0 tx=0x7f39440327b0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 -- 172.21.15.73:0/946490893 shutdown_connections 2024-09-10T07:40:46.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f393c03cae0 0x7f393c03eed0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:6800/142266274,v1:172.21.15.73:6801/142266274] conn(0x7f393c039020 0x7f393c03b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 --2- 172.21.15.73:0/946490893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3954106750 0x7f395419b940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 -- 172.21.15.73:0/946490893 >> 172.21.15.73:0/946490893 conn(0x7f3954101ea0 msgr2=0x7f3954102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:46.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 -- 172.21.15.73:0/946490893 shutdown_connections 2024-09-10T07:40:46.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:45.594+0000 7f395a172640 1 -- 172.21.15.73:0/946490893 wait complete. 2024-09-10T07:40:46.311 INFO:teuthology.orchestra.run.smithi073.stdout:mgr epoch 9 is available 2024-09-10T07:40:46.311 INFO:teuthology.orchestra.run.smithi073.stdout:Generating a dashboard self-signed certificate... 2024-09-10T07:40:46.680 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:46 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:45] ENGINE Bus STARTING 2024-09-10T07:40:46.680 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:46 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:45] ENGINE Serving on http://172.21.15.73:8765 2024-09-10T07:40:46.680 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:46 smithi073 ceph-mon[30850]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T07:40:46.680 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:46 smithi073 ceph-mon[30850]: mgrmap e11: x(active, since 1.00603s) 2024-09-10T07:40:46.680 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:46 smithi073 ceph-mon[30850]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:46 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:45] ENGINE Serving on https://172.21.15.73:7150 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:46 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:45] ENGINE Bus STARTED 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:46 smithi073 ceph-mon[30850]: [10/Sep/2024:07:40:45] ENGINE Error in HTTPServer.serve 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: Traceback (most recent call last): 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._connections.run(self.expiration_interval) 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._run(expiration_interval) 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:40:46.681 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:40:46.682 INFO:journalctl@ceph.mon.a.smithi073.stdout: s = self.context.wrap_socket( 2024-09-10T07:40:46.682 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:40:46.682 INFO:journalctl@ceph.mon.a.smithi073.stdout: return self.sslsocket_class._create( 2024-09-10T07:40:46.682 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:40:46.682 INFO:journalctl@ceph.mon.a.smithi073.stdout: self.do_handshake() 2024-09-10T07:40:46.682 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:40:46.682 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._sslobj.do_handshake() 2024-09-10T07:40:46.682 INFO:journalctl@ceph.mon.a.smithi073.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:40:47.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.680+0000 7f4bbf620640 1 Processor -- start 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.680+0000 7f4bbf620640 1 -- start start 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.681+0000 7f4bbf620640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb8107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.681+0000 7f4bbf620640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb8108220 con 0x7f4bb8107850 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.681+0000 7f4bbd3bc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb8107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.681+0000 7f4bbd3bc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb8107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41828/0 (socket says 172.21.15.73:41828) 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.681+0000 7f4bbd3bc640 1 -- 172.21.15.73:0/2824300481 learned_addr learned my addr 172.21.15.73:0/2824300481 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.681+0000 7f4bbd3bc640 1 -- 172.21.15.73:0/2824300481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb8108a50 con 0x7f4bb8107850 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.682+0000 7f4bbd3bc640 1 --2- 172.21.15.73:0/2824300481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb8107c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009820 tx=0x7f4bb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef8e82b12c4b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.682+0000 7f4baffff640 1 -- 172.21.15.73:0/2824300481 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb4037070 con 0x7f4bb8107850 2024-09-10T07:40:47.518 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.682+0000 7f4baffff640 1 -- 172.21.15.73:0/2824300481 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bb4032920 con 0x7f4bb8107850 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.682+0000 7f4baffff640 1 -- 172.21.15.73:0/2824300481 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb4030810 con 0x7f4bb8107850 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 -- 172.21.15.73:0/2824300481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 msgr2=0x7f4bb8107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 --2- 172.21.15.73:0/2824300481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb8107c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009820 tx=0x7f4bb402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 -- 172.21.15.73:0/2824300481 shutdown_connections 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 --2- 172.21.15.73:0/2824300481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb8107c50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 -- 172.21.15.73:0/2824300481 >> 172.21.15.73:0/2824300481 conn(0x7f4bb8102fc0 msgr2=0x7f4bb8105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 -- 172.21.15.73:0/2824300481 shutdown_connections 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 -- 172.21.15.73:0/2824300481 wait complete. 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 Processor -- start 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 -- start start 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.683+0000 7f4bbf620640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb810be00 con 0x7f4bb8107850 2024-09-10T07:40:47.519 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bbd3bc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bbd3bc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41838/0 (socket says 172.21.15.73:41838) 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bbd3bc640 1 -- 172.21.15.73:0/1476668396 learned_addr learned my addr 172.21.15.73:0/1476668396 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bbd3bc640 1 -- 172.21.15.73:0/1476668396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb819be20 con 0x7f4bb8107850 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bbd3bc640 1 --2- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb819b8e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4030560 tx=0x7f4bb4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bae7fc640 1 -- 172.21.15.73:0/1476668396 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb4037040 con 0x7f4bb8107850 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb819c0b0 con 0x7f4bb8107850 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bae7fc640 1 -- 172.21.15.73:0/1476668396 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bb4040070 con 0x7f4bb8107850 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bae7fc640 1 -- 172.21.15.73:0/1476668396 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb403a6d0 con 0x7f4bb8107850 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.684+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb819eda0 con 0x7f4bb8107850 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.685+0000 7f4bae7fc640 1 -- 172.21.15.73:0/1476668396 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f4bb403b420 con 0x7f4bb8107850 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.685+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb810bf80 con 0x7f4bb8107850 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.685+0000 7f4bae7fc640 1 --2- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f4ba4038fc0 0x7f4ba403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:47.520 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.686+0000 7f4bae7fc640 1 -- 172.21.15.73:0/1476668396 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4bb406c650 con 0x7f4bb8107850 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.686+0000 7f4bbcbbb640 1 --2- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f4ba4038fc0 0x7f4ba403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.686+0000 7f4bbcbbb640 1 --2- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f4ba4038fc0 0x7f4ba403b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80098c0 tx=0x7f4ba8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.691+0000 7f4bae7fc640 1 -- 172.21.15.73:0/1476668396 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4bb404a200 con 0x7f4bb8107850 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.886+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f4bb8104330 con 0x7f4ba4038fc0 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.971+0000 7f4bae7fc640 1 -- 172.21.15.73:0/1476668396 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f4bb8104330 con 0x7f4ba4038fc0 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f4ba4038fc0 msgr2=0x7f4ba403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 --2- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f4ba4038fc0 0x7f4ba403b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80098c0 tx=0x7f4ba8006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 msgr2=0x7f4bb819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 --2- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb819b8e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4030560 tx=0x7f4bb4032670 comp rx=0 tx=0).stop 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 shutdown_connections 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 --2- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f4ba4038fc0 0x7f4ba403b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 --2- 172.21.15.73:0/1476668396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bb8107850 0x7f4bb819b8e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 >> 172.21.15.73:0/1476668396 conn(0x7f4bb8102fc0 msgr2=0x7f4bb8103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:47.521 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 shutdown_connections 2024-09-10T07:40:47.522 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:46.974+0000 7f4bbf620640 1 -- 172.21.15.73:0/1476668396 wait complete. 2024-09-10T07:40:47.522 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial admin user... 2024-09-10T07:40:47.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:47 smithi073 ceph-mon[30850]: mgrmap e12: x(active, since 2s) 2024-09-10T07:40:47.871 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:47.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:47.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:48.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:48 smithi073 ceph-mon[30850]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:48.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:48.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:49.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Jn18HUD2IPNm2r70ffCT1uXaedL.RDAoFlckAMLK0w5.7N4rKf/by", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725954048, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T07:40:49.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.972+0000 7fdd6bb9e640 1 Processor -- start 2024-09-10T07:40:49.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.973+0000 7fdd6bb9e640 1 -- start start 2024-09-10T07:40:49.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.973+0000 7fdd6bb9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd64106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:49.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.973+0000 7fdd6bb9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdd641070e0 con 0x7fdd64106710 2024-09-10T07:40:49.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.973+0000 7fdd6993a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd64106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:49.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.973+0000 7fdd6993a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd64106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41842/0 (socket says 172.21.15.73:41842) 2024-09-10T07:40:49.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.973+0000 7fdd6993a640 1 -- 172.21.15.73:0/3898281038 learned_addr learned my addr 172.21.15.73:0/3898281038 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.973+0000 7fdd6993a640 1 -- 172.21.15.73:0/3898281038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd64107910 con 0x7fdd64106710 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.974+0000 7fdd6993a640 1 --2- 172.21.15.73:0/3898281038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd64106b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009820 tx=0x7fdd6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894ffc471f3999ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.974+0000 7fdd68938640 1 -- 172.21.15.73:0/3898281038 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd60037070 con 0x7fdd64106710 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.974+0000 7fdd68938640 1 -- 172.21.15.73:0/3898281038 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd60032920 con 0x7fdd64106710 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.974+0000 7fdd68938640 1 -- 172.21.15.73:0/3898281038 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd60030810 con 0x7fdd64106710 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.975+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/3898281038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 msgr2=0x7fdd64106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.975+0000 7fdd6bb9e640 1 --2- 172.21.15.73:0/3898281038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd64106b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009820 tx=0x7fdd6002a270 comp rx=0 tx=0).stop 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.975+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/3898281038 shutdown_connections 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.975+0000 7fdd6bb9e640 1 --2- 172.21.15.73:0/3898281038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd64106b10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.975+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/3898281038 >> 172.21.15.73:0/3898281038 conn(0x7fdd64101e80 msgr2=0x7fdd641042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.975+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/3898281038 shutdown_connections 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.975+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/3898281038 wait complete. 2024-09-10T07:40:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd6bb9e640 1 Processor -- start 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd6bb9e640 1 -- start start 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd6bb9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd6419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd6bb9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6410acc0 con 0x7fdd64106710 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd6993a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd6419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd6993a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd6419b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41858/0 (socket says 172.21.15.73:41858) 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd6993a640 1 -- 172.21.15.73:0/1412002074 learned_addr learned my addr 172.21.15.73:0/1412002074 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd6993a640 1 -- 172.21.15.73:0/1412002074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6419bde0 con 0x7fdd64106710 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd6993a640 1 --2- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd6419b8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd600097f0 tx=0x7fdd600327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.976+0000 7fdd5affd640 1 -- 172.21.15.73:0/1412002074 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd60037040 con 0x7fdd64106710 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.977+0000 7fdd5affd640 1 -- 172.21.15.73:0/1412002074 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd60030cc0 con 0x7fdd64106710 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.977+0000 7fdd5affd640 1 -- 172.21.15.73:0/1412002074 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6003a640 con 0x7fdd64106710 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.977+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6419c070 con 0x7fdd64106710 2024-09-10T07:40:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.977+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6419ed60 con 0x7fdd64106710 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.977+0000 7fdd5affd640 1 -- 172.21.15.73:0/1412002074 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fdd6003a8f0 con 0x7fdd64106710 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.978+0000 7fdd5affd640 1 --2- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdd50039020 0x7fdd5003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.978+0000 7fdd5affd640 1 -- 172.21.15.73:0/1412002074 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdd6006c660 con 0x7fdd64106710 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.978+0000 7fdd69139640 1 --2- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdd50039020 0x7fdd5003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.978+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6410ae40 con 0x7fdd64106710 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.978+0000 7fdd69139640 1 --2- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdd50039020 0x7fdd5003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdd540098c0 tx=0x7fdd54006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:47.984+0000 7fdd5affd640 1 -- 172.21.15.73:0/1412002074 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd600328c0 con 0x7fdd64106710 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.173+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fdd6419c550 con 0x7fdd50039020 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.406+0000 7fdd5affd640 1 -- 172.21.15.73:0/1412002074 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fdd6419c550 con 0x7fdd50039020 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdd50039020 msgr2=0x7fdd5003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:49.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 --2- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdd50039020 0x7fdd5003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdd540098c0 tx=0x7fdd54006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 msgr2=0x7fdd6419b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 --2- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd6419b8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd600097f0 tx=0x7fdd600327b0 comp rx=0 tx=0).stop 2024-09-10T07:40:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 shutdown_connections 2024-09-10T07:40:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 --2- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdd50039020 0x7fdd5003b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 --2- 172.21.15.73:0/1412002074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd64106710 0x7fdd6419b8a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 >> 172.21.15.73:0/1412002074 conn(0x7fdd64101e80 msgr2=0x7fdd64102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 shutdown_connections 2024-09-10T07:40:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:48.409+0000 7fdd6bb9e640 1 -- 172.21.15.73:0/1412002074 wait complete. 2024-09-10T07:40:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:Fetching dashboard port number... 2024-09-10T07:40:49.804 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:49 smithi073 ceph-mon[30850]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:50.954 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:50 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1541542876' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T07:40:50.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T07:40:50.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.614+0000 7f08e2569640 1 Processor -- start 2024-09-10T07:40:50.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.614+0000 7f08e2569640 1 -- start start 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.614+0000 7f08e2569640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc07cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.614+0000 7f08e2569640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc07d1a0 con 0x7f08dc07e770 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.614+0000 7f08dbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc07cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.614+0000 7f08dbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc07cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41868/0 (socket says 172.21.15.73:41868) 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.614+0000 7f08dbfff640 1 -- 172.21.15.73:0/1886651318 learned_addr learned my addr 172.21.15.73:0/1886651318 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.614+0000 7f08dbfff640 1 -- 172.21.15.73:0/1886651318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc07d320 con 0x7f08dc07e770 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.615+0000 7f08dbfff640 1 --2- 172.21.15.73:0/1886651318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc07cbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009820 tx=0x7f08cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85a70ff31fa84b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.615+0000 7f08daffd640 1 -- 172.21.15.73:0/1886651318 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08cc037070 con 0x7f08dc07e770 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.615+0000 7f08daffd640 1 -- 172.21.15.73:0/1886651318 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08cc032920 con 0x7f08dc07e770 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.615+0000 7f08daffd640 1 -- 172.21.15.73:0/1886651318 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08cc030810 con 0x7f08dc07e770 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.616+0000 7f08e2569640 1 -- 172.21.15.73:0/1886651318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 msgr2=0x7f08dc07cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:50.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.616+0000 7f08e2569640 1 --2- 172.21.15.73:0/1886651318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc07cbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009820 tx=0x7f08cc02a270 comp rx=0 tx=0).stop 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.616+0000 7f08e2569640 1 -- 172.21.15.73:0/1886651318 shutdown_connections 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.616+0000 7f08e2569640 1 --2- 172.21.15.73:0/1886651318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc07cbd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.616+0000 7f08e2569640 1 -- 172.21.15.73:0/1886651318 >> 172.21.15.73:0/1886651318 conn(0x7f08dc102fc0 msgr2=0x7f08dc105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.616+0000 7f08e2569640 1 -- 172.21.15.73:0/1886651318 shutdown_connections 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.616+0000 7f08e2569640 1 -- 172.21.15.73:0/1886651318 wait complete. 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.617+0000 7f08e2569640 1 Processor -- start 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.617+0000 7f08e2569640 1 -- start start 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.617+0000 7f08e2569640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc19db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.617+0000 7f08e2569640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc10df00 con 0x7f08dc07e770 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.617+0000 7f08dbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.617+0000 7f08dbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc19db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41882/0 (socket says 172.21.15.73:41882) 2024-09-10T07:40:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.617+0000 7f08dbfff640 1 -- 172.21.15.73:0/1541542876 learned_addr learned my addr 172.21.15.73:0/1541542876 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.617+0000 7f08dbfff640 1 -- 172.21.15.73:0/1541542876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc19e040 con 0x7f08dc07e770 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.618+0000 7f08dbfff640 1 --2- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc19db00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f08cc030560 tx=0x7f08cc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.618+0000 7f08d97fa640 1 -- 172.21.15.73:0/1541542876 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08cc037040 con 0x7f08dc07e770 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.618+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08dc19e2d0 con 0x7f08dc07e770 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.618+0000 7f08d97fa640 1 -- 172.21.15.73:0/1541542876 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08cc040070 con 0x7f08dc07e770 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.618+0000 7f08d97fa640 1 -- 172.21.15.73:0/1541542876 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08cc03a6d0 con 0x7f08dc07e770 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.618+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08dc1a0fc0 con 0x7f08dc07e770 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.619+0000 7f08d97fa640 1 -- 172.21.15.73:0/1541542876 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f08cc03bb20 con 0x7f08dc07e770 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.619+0000 7f08d97fa640 1 --2- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f08c4038fc0 0x7f08c403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.619+0000 7f08d97fa640 1 -- 172.21.15.73:0/1541542876 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f08cc06c630 con 0x7f08dc07e770 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.619+0000 7f08db7fe640 1 --2- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f08c4038fc0 0x7f08c403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.619+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08dc07cc50 con 0x7f08dc07e770 2024-09-10T07:40:50.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.619+0000 7f08db7fe640 1 --2- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f08c4038fc0 0x7f08c403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f08d00098c0 tx=0x7f08d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.628+0000 7f08d97fa640 1 -- 172.21.15.73:0/1541542876 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08cc0328f0 con 0x7f08dc07e770 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.804+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f08dc1a1480 con 0x7f08dc07e770 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.805+0000 7f08d97fa640 1 -- 172.21.15.73:0/1541542876 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f08cc04a200 con 0x7f08dc07e770 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f08c4038fc0 msgr2=0x7f08c403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 --2- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f08c4038fc0 0x7f08c403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f08d00098c0 tx=0x7f08d0006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 msgr2=0x7f08dc19db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 --2- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc19db00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f08cc030560 tx=0x7f08cc032670 comp rx=0 tx=0).stop 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 shutdown_connections 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 --2- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f08c4038fc0 0x7f08c403b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 --2- 172.21.15.73:0/1541542876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08dc07e770 0x7f08dc19db00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 >> 172.21.15.73:0/1541542876 conn(0x7f08dc102fc0 msgr2=0x7f08dc103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 shutdown_connections 2024-09-10T07:40:50.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:49.807+0000 7f08e2569640 1 -- 172.21.15.73:0/1541542876 wait complete. 2024-09-10T07:40:50.972 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T07:40:50.972 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-09-10T07:40:50.980 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T07:40:50.980 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-09-10T07:40:50.980 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-09-10T07:40:50.980 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T07:40:50.983 INFO:teuthology.orchestra.run.smithi073.stdout:Ceph Dashboard is now available at: 2024-09-10T07:40:50.983 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:50.983 INFO:teuthology.orchestra.run.smithi073.stdout: URL: https://smithi073.front.sepia.ceph.com:8443/ 2024-09-10T07:40:50.983 INFO:teuthology.orchestra.run.smithi073.stdout: User: admin 2024-09-10T07:40:50.983 INFO:teuthology.orchestra.run.smithi073.stdout: Password: gnmnbnxo62 2024-09-10T07:40:50.983 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:50.983 INFO:teuthology.orchestra.run.smithi073.stdout:Saving cluster configuration to /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config directory 2024-09-10T07:40:51.951 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:51 smithi073 ceph-mon[30850]: mgrmap e13: x(active, since 6s) 2024-09-10T07:40:52.234 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.394+0000 7fb9e17e7640 1 Processor -- start 2024-09-10T07:40:52.234 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.394+0000 7fb9e17e7640 1 -- start start 2024-09-10T07:40:52.234 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.395+0000 7fb9e17e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc10a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.234 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.395+0000 7fb9e17e7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc07bdf0 con 0x7fb9dc108360 2024-09-10T07:40:52.234 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.395+0000 7fb9daffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc10a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.234 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.395+0000 7fb9daffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc10a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47544/0 (socket says 172.21.15.73:47544) 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.395+0000 7fb9daffd640 1 -- 172.21.15.73:0/3631998927 learned_addr learned my addr 172.21.15.73:0/3631998927 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.395+0000 7fb9daffd640 1 -- 172.21.15.73:0/3631998927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc10ac90 con 0x7fb9dc108360 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.396+0000 7fb9daffd640 1 --2- 172.21.15.73:0/3631998927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc10a750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009820 tx=0x7fb9cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a393b1c9de8a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.396+0000 7fb9d9ffb640 1 -- 172.21.15.73:0/3631998927 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9cc037070 con 0x7fb9dc108360 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.396+0000 7fb9d9ffb640 1 -- 172.21.15.73:0/3631998927 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9cc032920 con 0x7fb9dc108360 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.396+0000 7fb9d9ffb640 1 -- 172.21.15.73:0/3631998927 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9cc030810 con 0x7fb9dc108360 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.396+0000 7fb9e17e7640 1 -- 172.21.15.73:0/3631998927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 msgr2=0x7fb9dc10a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.396+0000 7fb9e17e7640 1 --2- 172.21.15.73:0/3631998927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc10a750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009820 tx=0x7fb9cc02a270 comp rx=0 tx=0).stop 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.397+0000 7fb9e17e7640 1 -- 172.21.15.73:0/3631998927 shutdown_connections 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.397+0000 7fb9e17e7640 1 --2- 172.21.15.73:0/3631998927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc10a750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.397+0000 7fb9e17e7640 1 -- 172.21.15.73:0/3631998927 >> 172.21.15.73:0/3631998927 conn(0x7fb9dc101e80 msgr2=0x7fb9dc1042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.397+0000 7fb9e17e7640 1 -- 172.21.15.73:0/3631998927 shutdown_connections 2024-09-10T07:40:52.235 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.397+0000 7fb9e17e7640 1 -- 172.21.15.73:0/3631998927 wait complete. 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.397+0000 7fb9e17e7640 1 Processor -- start 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.397+0000 7fb9e17e7640 1 -- start start 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9e17e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9e17e7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc10bc50 con 0x7fb9dc108360 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9daffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9daffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47550/0 (socket says 172.21.15.73:47550) 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9daffd640 1 -- 172.21.15.73:0/209330418 learned_addr learned my addr 172.21.15.73:0/209330418 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9daffd640 1 -- 172.21.15.73:0/209330418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc19bd70 con 0x7fb9dc108360 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9daffd640 1 --2- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc19b830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097f0 tx=0x7fb9cc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9c3fff640 1 -- 172.21.15.73:0/209330418 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9cc037040 con 0x7fb9dc108360 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9c3fff640 1 -- 172.21.15.73:0/209330418 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9cc030cc0 con 0x7fb9dc108360 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9dc19c000 con 0x7fb9dc108360 2024-09-10T07:40:52.236 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9c3fff640 1 -- 172.21.15.73:0/209330418 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9cc03a6b0 con 0x7fb9dc108360 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.398+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9dc19ecf0 con 0x7fb9dc108360 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.399+0000 7fb9c3fff640 1 -- 172.21.15.73:0/209330418 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb9cc03a850 con 0x7fb9dc108360 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.399+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9dc1087c0 con 0x7fb9dc108360 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.399+0000 7fb9c3fff640 1 --2- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9c40390c0 0x7fb9c403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.400+0000 7fb9c3fff640 1 -- 172.21.15.73:0/209330418 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb9cc06c8f0 con 0x7fb9dc108360 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.400+0000 7fb9da7fc640 1 --2- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9c40390c0 0x7fb9c403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.400+0000 7fb9da7fc640 1 --2- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9c40390c0 0x7fb9c403b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00098c0 tx=0x7fb9d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.404+0000 7fb9c3fff640 1 -- 172.21.15.73:0/209330418 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9cc039760 con 0x7fb9dc108360 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.661+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fb9dc19eec0 con 0x7fb9dc108360 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.663+0000 7fb9c3fff640 1 -- 172.21.15.73:0/209330418 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fb9cc0371e0 con 0x7fb9dc108360 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9c40390c0 msgr2=0x7fb9c403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 --2- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9c40390c0 0x7fb9c403b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00098c0 tx=0x7fb9d0006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.237 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 msgr2=0x7fb9dc19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 --2- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc19b830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097f0 tx=0x7fb9cc0327b0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 shutdown_connections 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 --2- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9c40390c0 0x7fb9c403b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 --2- 172.21.15.73:0/209330418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9dc108360 0x7fb9dc19b830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 >> 172.21.15.73:0/209330418 conn(0x7fb9dc101e80 msgr2=0x7fb9dc102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 shutdown_connections 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-09-10T07:40:51.665+0000 7fb9e17e7640 1 -- 172.21.15.73:0/209330418 wait complete. 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:52.238 INFO:teuthology.orchestra.run.smithi073.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout: ceph telemetry on 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout:For more information see: 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:40:52.239 INFO:teuthology.orchestra.run.smithi073.stdout:Bootstrap complete. 2024-09-10T07:40:52.272 INFO:tasks.cephadm:Fetching config... 2024-09-10T07:40:52.272 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:40:52.272 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T07:40:52.288 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T07:40:52.288 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:40:52.288 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T07:40:52.344 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T07:40:52.344 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:40:52.344 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T07:40:52.409 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T07:40:52.409 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:40:52.409 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T07:40:52.465 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T07:40:52.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL6tzUA0bnFMmDWBcX9X05GJepNsYkRtz1mKyS/wWbo4hH7pYN2NucJUonA6oZYtKJWBkePpGiDr+2RehRggST4XR0705p4sxTA3GV1EzpILRQHvGeArVbMxUWFgN4q/jTy6/JLQa4vfIfH7GukiZBSMsmPi5KYFM+p3zLxtPPAxH0GvD0SXRYoeSwjafQRobmelmZ2QDpk9DLO5qVol+hxpppPPp2T/uc6lp6zOJ9myno/D91UT2ccMQqdgEb8/UfHw1vnEvXA2iHek4DqLbFxuvLcigsXn1lI/WZEG01PjuuH5Og3IJPiQP/dSsbtPAO5awV7D/US2wZ66Qd+djmdwp766l9vv2CaOwv+fRMOiivj5Xl8JTghcqTWd5G3yURs/dt3+Sti7zjfXbZwmweMiTJ25kzqdLvVYWJrx12YaZEAN896tgRQsEBZcdi3T12UhR7QtShyPTueWbszsJpKVbYOrqRCP0NhHIDBSCQtnqmVTUomi/G3/JG2ySsy+0= ceph-c025e280-6f47-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi073.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL6tzUA0bnFMmDWBcX9X05GJepNsYkRtz1mKyS/wWbo4hH7pYN2NucJUonA6oZYtKJWBkePpGiDr+2RehRggST4XR0705p4sxTA3GV1EzpILRQHvGeArVbMxUWFgN4q/jTy6/JLQa4vfIfH7GukiZBSMsmPi5KYFM+p3zLxtPPAxH0GvD0SXRYoeSwjafQRobmelmZ2QDpk9DLO5qVol+hxpppPPp2T/uc6lp6zOJ9myno/D91UT2ccMQqdgEb8/UfHw1vnEvXA2iHek4DqLbFxuvLcigsXn1lI/WZEG01PjuuH5Og3IJPiQP/dSsbtPAO5awV7D/US2wZ66Qd+djmdwp766l9vv2CaOwv+fRMOiivj5Xl8JTghcqTWd5G3yURs/dt3+Sti7zjfXbZwmweMiTJ25kzqdLvVYWJrx12YaZEAN896tgRQsEBZcdi3T12UhR7QtShyPTueWbszsJpKVbYOrqRCP0NhHIDBSCQtnqmVTUomi/G3/JG2ySsy+0= ceph-c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:52.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL6tzUA0bnFMmDWBcX9X05GJepNsYkRtz1mKyS/wWbo4hH7pYN2NucJUonA6oZYtKJWBkePpGiDr+2RehRggST4XR0705p4sxTA3GV1EzpILRQHvGeArVbMxUWFgN4q/jTy6/JLQa4vfIfH7GukiZBSMsmPi5KYFM+p3zLxtPPAxH0GvD0SXRYoeSwjafQRobmelmZ2QDpk9DLO5qVol+hxpppPPp2T/uc6lp6zOJ9myno/D91UT2ccMQqdgEb8/UfHw1vnEvXA2iHek4DqLbFxuvLcigsXn1lI/WZEG01PjuuH5Og3IJPiQP/dSsbtPAO5awV7D/US2wZ66Qd+djmdwp766l9vv2CaOwv+fRMOiivj5Xl8JTghcqTWd5G3yURs/dt3+Sti7zjfXbZwmweMiTJ25kzqdLvVYWJrx12YaZEAN896tgRQsEBZcdi3T12UhR7QtShyPTueWbszsJpKVbYOrqRCP0NhHIDBSCQtnqmVTUomi/G3/JG2ySsy+0= ceph-c025e280-6f47-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T07:40:52.593 INFO:teuthology.orchestra.run.smithi102.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL6tzUA0bnFMmDWBcX9X05GJepNsYkRtz1mKyS/wWbo4hH7pYN2NucJUonA6oZYtKJWBkePpGiDr+2RehRggST4XR0705p4sxTA3GV1EzpILRQHvGeArVbMxUWFgN4q/jTy6/JLQa4vfIfH7GukiZBSMsmPi5KYFM+p3zLxtPPAxH0GvD0SXRYoeSwjafQRobmelmZ2QDpk9DLO5qVol+hxpppPPp2T/uc6lp6zOJ9myno/D91UT2ccMQqdgEb8/UfHw1vnEvXA2iHek4DqLbFxuvLcigsXn1lI/WZEG01PjuuH5Og3IJPiQP/dSsbtPAO5awV7D/US2wZ66Qd+djmdwp766l9vv2CaOwv+fRMOiivj5Xl8JTghcqTWd5G3yURs/dt3+Sti7zjfXbZwmweMiTJ25kzqdLvVYWJrx12YaZEAN896tgRQsEBZcdi3T12UhR7QtShyPTueWbszsJpKVbYOrqRCP0NhHIDBSCQtnqmVTUomi/G3/JG2ySsy+0= ceph-c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:52.605 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL6tzUA0bnFMmDWBcX9X05GJepNsYkRtz1mKyS/wWbo4hH7pYN2NucJUonA6oZYtKJWBkePpGiDr+2RehRggST4XR0705p4sxTA3GV1EzpILRQHvGeArVbMxUWFgN4q/jTy6/JLQa4vfIfH7GukiZBSMsmPi5KYFM+p3zLxtPPAxH0GvD0SXRYoeSwjafQRobmelmZ2QDpk9DLO5qVol+hxpppPPp2T/uc6lp6zOJ9myno/D91UT2ccMQqdgEb8/UfHw1vnEvXA2iHek4DqLbFxuvLcigsXn1lI/WZEG01PjuuH5Og3IJPiQP/dSsbtPAO5awV7D/US2wZ66Qd+djmdwp766l9vv2CaOwv+fRMOiivj5Xl8JTghcqTWd5G3yURs/dt3+Sti7zjfXbZwmweMiTJ25kzqdLvVYWJrx12YaZEAN896tgRQsEBZcdi3T12UhR7QtShyPTueWbszsJpKVbYOrqRCP0NhHIDBSCQtnqmVTUomi/G3/JG2ySsy+0= ceph-c025e280-6f47-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T07:40:52.648 INFO:teuthology.orchestra.run.smithi159.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL6tzUA0bnFMmDWBcX9X05GJepNsYkRtz1mKyS/wWbo4hH7pYN2NucJUonA6oZYtKJWBkePpGiDr+2RehRggST4XR0705p4sxTA3GV1EzpILRQHvGeArVbMxUWFgN4q/jTy6/JLQa4vfIfH7GukiZBSMsmPi5KYFM+p3zLxtPPAxH0GvD0SXRYoeSwjafQRobmelmZ2QDpk9DLO5qVol+hxpppPPp2T/uc6lp6zOJ9myno/D91UT2ccMQqdgEb8/UfHw1vnEvXA2iHek4DqLbFxuvLcigsXn1lI/WZEG01PjuuH5Og3IJPiQP/dSsbtPAO5awV7D/US2wZ66Qd+djmdwp766l9vv2CaOwv+fRMOiivj5Xl8JTghcqTWd5G3yURs/dt3+Sti7zjfXbZwmweMiTJ25kzqdLvVYWJrx12YaZEAN896tgRQsEBZcdi3T12UhR7QtShyPTueWbszsJpKVbYOrqRCP0NhHIDBSCQtnqmVTUomi/G3/JG2ySsy+0= ceph-c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:40:52.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T07:40:52.905 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:40:52.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:52 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/209330418' entity='client.admin' 2024-09-10T07:40:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.378+0000 7f1194628640 1 -- 172.21.15.73:0/3270253644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 msgr2=0x7f118c1044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.378+0000 7f1194628640 1 --2- 172.21.15.73:0/3270253644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 0x7f118c1044c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1184009880 tx=0x7f118402a5d0 comp rx=0 tx=0).stop 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.378+0000 7f1194628640 1 -- 172.21.15.73:0/3270253644 shutdown_connections 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.378+0000 7f1194628640 1 --2- 172.21.15.73:0/3270253644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 0x7f118c1044c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.378+0000 7f1194628640 1 -- 172.21.15.73:0/3270253644 >> 172.21.15.73:0/3270253644 conn(0x7f118c0fbcd0 msgr2=0x7f118c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.378+0000 7f1194628640 1 -- 172.21.15.73:0/3270253644 shutdown_connections 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.378+0000 7f1194628640 1 -- 172.21.15.73:0/3270253644 wait complete. 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f1194628640 1 Processor -- start 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f1194628640 1 -- start start 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f1194628640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 0x7f118c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f1194628640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f118c107670 con 0x7f118c1020d0 2024-09-10T07:40:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f11923c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 0x7f118c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f11923c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 0x7f118c196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47566/0 (socket says 172.21.15.73:47566) 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f11923c4640 1 -- 172.21.15.73:0/621178790 learned_addr learned my addr 172.21.15.73:0/621178790 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f11923c4640 1 -- 172.21.15.73:0/621178790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c197250 con 0x7f118c1020d0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f11923c4640 1 --2- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 0x7f118c196d10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1184004f60 tx=0x7f11840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f118b7fe640 1 -- 172.21.15.73:0/621178790 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f118403f070 con 0x7f118c1020d0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f118b7fe640 1 -- 172.21.15.73:0/621178790 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1184003ad0 con 0x7f118c1020d0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118c197540 con 0x7f118c1020d0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f118b7fe640 1 -- 172.21.15.73:0/621178790 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1184035030 con 0x7f118c1020d0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.379+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118c19a1c0 con 0x7f118c1020d0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.380+0000 7f118b7fe640 1 -- 172.21.15.73:0/621178790 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1184042070 con 0x7f118c1020d0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.380+0000 7f118b7fe640 1 --2- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f1174039060 0x7f117403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.380+0000 7f118b7fe640 1 -- 172.21.15.73:0/621178790 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f118406cdd0 con 0x7f118c1020d0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.381+0000 7f1191bc3640 1 --2- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f1174039060 0x7f117403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.380+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118c107df0 con 0x7f118c1020d0 2024-09-10T07:40:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.381+0000 7f1191bc3640 1 --2- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f1174039060 0x7f117403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11800098c0 tx=0x7f1180006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.385+0000 7f118b7fe640 1 -- 172.21.15.73:0/621178790 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1184039350 con 0x7f118c1020d0 2024-09-10T07:40:53.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.555+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f118c02d860 con 0x7f118c1020d0 2024-09-10T07:40:53.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.558+0000 7f118b7fe640 1 -- 172.21.15.73:0/621178790 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f1184003c80 con 0x7f118c1020d0 2024-09-10T07:40:53.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f1174039060 msgr2=0x7f117403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:53.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 --2- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f1174039060 0x7f117403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11800098c0 tx=0x7f1180006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:53.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 msgr2=0x7f118c196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:53.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 --2- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 0x7f118c196d10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1184004f60 tx=0x7f11840048f0 comp rx=0 tx=0).stop 2024-09-10T07:40:53.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 shutdown_connections 2024-09-10T07:40:53.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 --2- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f1174039060 0x7f117403b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:53.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 --2- 172.21.15.73:0/621178790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f118c1020d0 0x7f118c196d10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:53.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 >> 172.21.15.73:0/621178790 conn(0x7f118c0fbcd0 msgr2=0x7f118c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:53.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 shutdown_connections 2024-09-10T07:40:53.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:53.560+0000 7f1194628640 1 -- 172.21.15.73:0/621178790 wait complete. 2024-09-10T07:40:54.632 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T07:40:54.632 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T07:40:54.824 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:54 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/621178790' entity='client.admin' 2024-09-10T07:40:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:40:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.516+0000 7fa6fde3a640 1 -- 172.21.15.73:0/2751049064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 msgr2=0x7fa6f8104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.516+0000 7fa6fde3a640 1 --2- 172.21.15.73:0/2751049064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 0x7fa6f8104500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009880 tx=0x7fa6e802a5d0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.516+0000 7fa6fde3a640 1 -- 172.21.15.73:0/2751049064 shutdown_connections 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.516+0000 7fa6fde3a640 1 --2- 172.21.15.73:0/2751049064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 0x7fa6f8104500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.516+0000 7fa6fde3a640 1 -- 172.21.15.73:0/2751049064 >> 172.21.15.73:0/2751049064 conn(0x7fa6f80fbcd0 msgr2=0x7fa6f80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.516+0000 7fa6fde3a640 1 -- 172.21.15.73:0/2751049064 shutdown_connections 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.516+0000 7fa6fde3a640 1 -- 172.21.15.73:0/2751049064 wait complete. 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.517+0000 7fa6fde3a640 1 Processor -- start 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.517+0000 7fa6fde3a640 1 -- start start 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.517+0000 7fa6fde3a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 0x7fa6f8101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.517+0000 7fa6fde3a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81076d0 con 0x7fa6f8102110 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.517+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 0x7fa6f8101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.517+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 0x7fa6f8101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47586/0 (socket says 172.21.15.73:47586) 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.517+0000 7fa6f77fe640 1 -- 172.21.15.73:0/1717106616 learned_addr learned my addr 172.21.15.73:0/1717106616 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.518+0000 7fa6f77fe640 1 -- 172.21.15.73:0/1717106616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f8101ed0 con 0x7fa6f8102110 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.518+0000 7fa6f77fe640 1 --2- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 0x7fa6f8101990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8004f60 tx=0x7fa6e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.518+0000 7fa6f57fa640 1 -- 172.21.15.73:0/1717106616 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6e803f070 con 0x7fa6f8102110 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.518+0000 7fa6f57fa640 1 -- 172.21.15.73:0/1717106616 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6e8003ad0 con 0x7fa6f8102110 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.518+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f81000c0 con 0x7fa6f8102110 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.518+0000 7fa6f57fa640 1 -- 172.21.15.73:0/1717106616 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6e8035030 con 0x7fa6f8102110 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.518+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f8100600 con 0x7fa6f8102110 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.519+0000 7fa6f57fa640 1 -- 172.21.15.73:0/1717106616 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa6e8042070 con 0x7fa6f8102110 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.519+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f8107e50 con 0x7fa6f8102110 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.519+0000 7fa6f57fa640 1 --2- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa6e4039060 0x7fa6e403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.519+0000 7fa6f57fa640 1 -- 172.21.15.73:0/1717106616 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa6e806d060 con 0x7fa6f8102110 2024-09-10T07:40:55.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.519+0000 7fa6effff640 1 --2- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa6e4039060 0x7fa6e403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.520+0000 7fa6effff640 1 --2- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa6e4039060 0x7fa6e403b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00098c0 tx=0x7fa6e0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.525+0000 7fa6f57fa640 1 -- 172.21.15.73:0/1717106616 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6e80433b0 con 0x7fa6f8102110 2024-09-10T07:40:55.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.700+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fa6f8190200 con 0x7fa6e4039060 2024-09-10T07:40:55.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.704+0000 7fa6f57fa640 1 -- 172.21.15.73:0/1717106616 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa6f8190200 con 0x7fa6e4039060 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa6e4039060 msgr2=0x7fa6e403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 --2- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa6e4039060 0x7fa6e403b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00098c0 tx=0x7fa6e0006db0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 msgr2=0x7fa6f8101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 --2- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 0x7fa6f8101990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8004f60 tx=0x7fa6e80048f0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 shutdown_connections 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 --2- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa6e4039060 0x7fa6e403b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 --2- 172.21.15.73:0/1717106616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6f8102110 0x7fa6f8101990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 >> 172.21.15.73:0/1717106616 conn(0x7fa6f80fbcd0 msgr2=0x7fa6f80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 shutdown_connections 2024-09-10T07:40:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:55.706+0000 7fa6fde3a640 1 -- 172.21.15.73:0/1717106616 wait complete. 2024-09-10T07:40:56.398 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi102 2024-09-10T07:40:56.398 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:40:56.398 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.conf 2024-09-10T07:40:56.418 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:40:56.418 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:40:56.476 INFO:tasks.cephadm:Adding host smithi102 to orchestrator... 2024-09-10T07:40:56.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch host add smithi102 2024-09-10T07:40:56.760 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:40:56.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:56 smithi073 ceph-mon[30850]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:40:56.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:56 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:57.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.318+0000 7fc940c3d640 1 -- 172.21.15.73:0/2263043355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 msgr2=0x7fc93c1044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.318+0000 7fc940c3d640 1 --2- 172.21.15.73:0/2263043355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 0x7fc93c1044c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009880 tx=0x7fc92c02a5d0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.318+0000 7fc940c3d640 1 -- 172.21.15.73:0/2263043355 shutdown_connections 2024-09-10T07:40:57.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.318+0000 7fc940c3d640 1 --2- 172.21.15.73:0/2263043355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 0x7fc93c1044c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.318+0000 7fc940c3d640 1 -- 172.21.15.73:0/2263043355 >> 172.21.15.73:0/2263043355 conn(0x7fc93c0fbcd0 msgr2=0x7fc93c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:57.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.318+0000 7fc940c3d640 1 -- 172.21.15.73:0/2263043355 shutdown_connections 2024-09-10T07:40:57.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.318+0000 7fc940c3d640 1 -- 172.21.15.73:0/2263043355 wait complete. 2024-09-10T07:40:57.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.319+0000 7fc940c3d640 1 Processor -- start 2024-09-10T07:40:57.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.319+0000 7fc940c3d640 1 -- start start 2024-09-10T07:40:57.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc940c3d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 0x7fc93c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc940c3d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c107670 con 0x7fc93c1020d0 2024-09-10T07:40:57.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc93a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 0x7fc93c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc93a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 0x7fc93c196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47614/0 (socket says 172.21.15.73:47614) 2024-09-10T07:40:57.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc93a59c640 1 -- 172.21.15.73:0/1755845884 learned_addr learned my addr 172.21.15.73:0/1755845884 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:40:57.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc93a59c640 1 -- 172.21.15.73:0/1755845884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c197250 con 0x7fc93c1020d0 2024-09-10T07:40:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc93a59c640 1 --2- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 0x7fc93c196d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc92c004f60 tx=0x7fc92c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc92b7fe640 1 -- 172.21.15.73:0/1755845884 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc92c03f070 con 0x7fc93c1020d0 2024-09-10T07:40:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c197540 con 0x7fc93c1020d0 2024-09-10T07:40:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc92b7fe640 1 -- 172.21.15.73:0/1755845884 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc92c003ad0 con 0x7fc93c1020d0 2024-09-10T07:40:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.320+0000 7fc92b7fe640 1 -- 172.21.15.73:0/1755845884 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc92c035030 con 0x7fc93c1020d0 2024-09-10T07:40:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.321+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c19a1c0 con 0x7fc93c1020d0 2024-09-10T07:40:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.321+0000 7fc92b7fe640 1 -- 172.21.15.73:0/1755845884 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc92c042070 con 0x7fc93c1020d0 2024-09-10T07:40:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.322+0000 7fc92b7fe640 1 --2- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc924039060 0x7fc92403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.322+0000 7fc92b7fe640 1 -- 172.21.15.73:0/1755845884 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc92c06ce60 con 0x7fc93c1020d0 2024-09-10T07:40:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.322+0000 7fc939d9b640 1 --2- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc924039060 0x7fc92403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.322+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93c107df0 con 0x7fc93c1020d0 2024-09-10T07:40:57.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.322+0000 7fc939d9b640 1 --2- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc924039060 0x7fc92403b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9300098c0 tx=0x7fc930006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:57.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.327+0000 7fc92b7fe640 1 -- 172.21.15.73:0/1755845884 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc92c09c1b0 con 0x7fc93c1020d0 2024-09-10T07:40:57.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:40:57.520+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}) -- 0x7fc93c062630 con 0x7fc924039060 2024-09-10T07:40:58.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:40:58.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:40:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:58 smithi073 ceph-mon[30850]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-10T07:40:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:58 smithi073 ceph-mon[30850]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:40:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:58 smithi073 ceph-mon[30850]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:40:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:58 smithi073 ceph-mon[30850]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:40:59.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:58 smithi073 ceph-mon[30850]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:00.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:40:59 smithi073 ceph-mon[30850]: Deploying cephadm binary to smithi102 2024-09-10T07:41:00.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.619+0000 7fc92b7fe640 1 -- 172.21.15.73:0/1755845884 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc93c062630 con 0x7fc924039060 2024-09-10T07:41:00.619 INFO:teuthology.orchestra.run.smithi073.stdout:Added host 'smithi102' with addr '172.21.15.102' 2024-09-10T07:41:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.621+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc924039060 msgr2=0x7fc92403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.621+0000 7fc940c3d640 1 --2- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc924039060 0x7fc92403b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9300098c0 tx=0x7fc930006db0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.621+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 msgr2=0x7fc93c196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.621+0000 7fc940c3d640 1 --2- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 0x7fc93c196d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc92c004f60 tx=0x7fc92c0048f0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.621+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 shutdown_connections 2024-09-10T07:41:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.621+0000 7fc940c3d640 1 --2- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc924039060 0x7fc92403b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.621+0000 7fc940c3d640 1 --2- 172.21.15.73:0/1755845884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc93c1020d0 0x7fc93c196d10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.621+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 >> 172.21.15.73:0/1755845884 conn(0x7fc93c0fbcd0 msgr2=0x7fc93c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.622+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 shutdown_connections 2024-09-10T07:41:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:00.622+0000 7fc940c3d640 1 -- 172.21.15.73:0/1755845884 wait complete. 2024-09-10T07:41:01.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T07:41:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:41:01.904 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:01.904 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:01 smithi073 ceph-mon[30850]: Added host smithi102 2024-09-10T07:41:01.904 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:01.905 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:01.905 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.904+0000 7fc6033d7640 1 -- 172.21.15.73:0/4139780557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 msgr2=0x7fc5fc102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.904+0000 7fc6033d7640 1 --2- 172.21.15.73:0/4139780557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 0x7fc5fc102b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009c20 tx=0x7fc5ec02ab20 comp rx=0 tx=0).stop 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.904+0000 7fc6033d7640 1 -- 172.21.15.73:0/4139780557 shutdown_connections 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.904+0000 7fc6033d7640 1 --2- 172.21.15.73:0/4139780557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 0x7fc5fc102b90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.904+0000 7fc6033d7640 1 -- 172.21.15.73:0/4139780557 >> 172.21.15.73:0/4139780557 conn(0x7fc5fc0fc1b0 msgr2=0x7fc5fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.904+0000 7fc6033d7640 1 -- 172.21.15.73:0/4139780557 shutdown_connections 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.904+0000 7fc6033d7640 1 -- 172.21.15.73:0/4139780557 wait complete. 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.905+0000 7fc6033d7640 1 Processor -- start 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.905+0000 7fc6033d7640 1 -- start start 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.905+0000 7fc6033d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 0x7fc5fc1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.905+0000 7fc6033d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc10bcb0 con 0x7fc5fc1027b0 2024-09-10T07:41:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.905+0000 7fc601173640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 0x7fc5fc1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.905+0000 7fc601173640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 0x7fc5fc1993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56150/0 (socket says 172.21.15.73:56150) 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.905+0000 7fc601173640 1 -- 172.21.15.73:0/3315449621 learned_addr learned my addr 172.21.15.73:0/3315449621 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.906+0000 7fc601173640 1 -- 172.21.15.73:0/3315449621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5fc1998f0 con 0x7fc5fc1027b0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.906+0000 7fc601173640 1 --2- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 0x7fc5fc1993b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec030040 tx=0x7fc5ec02eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.906+0000 7fc5fa7fc640 1 -- 172.21.15.73:0/3315449621 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5ec047070 con 0x7fc5fc1027b0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.906+0000 7fc5fa7fc640 1 -- 172.21.15.73:0/3315449621 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5ec0368e0 con 0x7fc5fc1027b0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.906+0000 7fc5fa7fc640 1 -- 172.21.15.73:0/3315449621 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5ec042420 con 0x7fc5fc1027b0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.906+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5fc199b80 con 0x7fc5fc1027b0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.906+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5fc199fe0 con 0x7fc5fc1027b0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.907+0000 7fc5fa7fc640 1 -- 172.21.15.73:0/3315449621 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc5ec04a070 con 0x7fc5fc1027b0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.907+0000 7fc5fa7fc640 1 --2- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc5e40390c0 0x7fc5e403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.907+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5fc06a750 con 0x7fc5fc1027b0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.907+0000 7fc5fa7fc640 1 -- 172.21.15.73:0/3315449621 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc5ec03d030 con 0x7fc5fc1027b0 2024-09-10T07:41:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.907+0000 7fc600972640 1 --2- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc5e40390c0 0x7fc5e403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.908+0000 7fc600972640 1 --2- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc5e40390c0 0x7fc5e403b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00098c0 tx=0x7fc5f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:01.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:01.912+0000 7fc5fa7fc640 1 -- 172.21.15.73:0/3315449621 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5ec032030 con 0x7fc5fc1027b0 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.084+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc5fc19a740 con 0x7fc5e40390c0 2024-09-10T07:41:02.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.085+0000 7fc5fa7fc640 1 -- 172.21.15.73:0/3315449621 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fc5fc19a740 con 0x7fc5e40390c0 2024-09-10T07:41:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:41:02.085 INFO:teuthology.orchestra.run.smithi073.stdout:[{"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}, {"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}] 2024-09-10T07:41:02.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc5e40390c0 msgr2=0x7fc5e403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 --2- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc5e40390c0 0x7fc5e403b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00098c0 tx=0x7fc5f0006db0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 msgr2=0x7fc5fc1993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 --2- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 0x7fc5fc1993b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec030040 tx=0x7fc5ec02eb50 comp rx=0 tx=0).stop 2024-09-10T07:41:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 shutdown_connections 2024-09-10T07:41:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 --2- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc5e40390c0 0x7fc5e403b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 --2- 172.21.15.73:0/3315449621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5fc1027b0 0x7fc5fc1993b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 >> 172.21.15.73:0/3315449621 conn(0x7fc5fc0fc1b0 msgr2=0x7fc5fc107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 shutdown_connections 2024-09-10T07:41:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:02.087+0000 7fc6033d7640 1 -- 172.21.15.73:0/3315449621 wait complete. 2024-09-10T07:41:02.692 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi159 2024-09-10T07:41:02.693 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:41:02.693 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.conf 2024-09-10T07:41:02.712 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:41:02.712 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:41:02.770 INFO:tasks.cephadm:Adding host smithi159 to orchestrator... 2024-09-10T07:41:02.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch host add smithi159 2024-09-10T07:41:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:41:03.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:03.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:02 smithi073 ceph-mon[30850]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.436+0000 7fdfa9f32640 1 -- 172.21.15.73:0/1030473951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 msgr2=0x7fdfa4109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.436+0000 7fdfa9f32640 1 --2- 172.21.15.73:0/1030473951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 0x7fdfa4109ba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009c20 tx=0x7fdf9402aa90 comp rx=0 tx=0).stop 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.436+0000 7fdfa9f32640 1 -- 172.21.15.73:0/1030473951 shutdown_connections 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.436+0000 7fdfa9f32640 1 --2- 172.21.15.73:0/1030473951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 0x7fdfa4109ba0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.436+0000 7fdfa9f32640 1 -- 172.21.15.73:0/1030473951 >> 172.21.15.73:0/1030473951 conn(0x7fdfa40ff480 msgr2=0x7fdfa41018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.436+0000 7fdfa9f32640 1 -- 172.21.15.73:0/1030473951 shutdown_connections 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.436+0000 7fdfa9f32640 1 -- 172.21.15.73:0/1030473951 wait complete. 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.437+0000 7fdfa9f32640 1 Processor -- start 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.437+0000 7fdfa9f32640 1 -- start start 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.437+0000 7fdfa9f32640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 0x7fdfa4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.437+0000 7fdfa9f32640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa410de80 con 0x7fdfa41097c0 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.437+0000 7fdfa37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 0x7fdfa4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.438+0000 7fdfa37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 0x7fdfa4199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56172/0 (socket says 172.21.15.73:56172) 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.438+0000 7fdfa37fe640 1 -- 172.21.15.73:0/2535038677 learned_addr learned my addr 172.21.15.73:0/2535038677 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.438+0000 7fdfa37fe640 1 -- 172.21.15.73:0/2535038677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa4199860 con 0x7fdfa41097c0 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.438+0000 7fdfa37fe640 1 --2- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 0x7fdfa4199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf94005e30 tx=0x7fdf9402fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.438+0000 7fdfa0ff9640 1 -- 172.21.15.73:0/2535038677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf94047070 con 0x7fdfa41097c0 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.438+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa4199b50 con 0x7fdfa41097c0 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.438+0000 7fdfa0ff9640 1 -- 172.21.15.73:0/2535038677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf94003df0 con 0x7fdfa41097c0 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.438+0000 7fdfa0ff9640 1 -- 172.21.15.73:0/2535038677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf94033050 con 0x7fdfa41097c0 2024-09-10T07:41:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.438+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa419dbf0 con 0x7fdfa41097c0 2024-09-10T07:41:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.439+0000 7fdfa0ff9640 1 -- 172.21.15.73:0/2535038677 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fdf9404a070 con 0x7fdfa41097c0 2024-09-10T07:41:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.439+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa4104f00 con 0x7fdfa41097c0 2024-09-10T07:41:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.439+0000 7fdfa0ff9640 1 --2- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdf8c039060 0x7fdf8c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.439+0000 7fdfa0ff9640 1 -- 172.21.15.73:0/2535038677 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdf9403e030 con 0x7fdfa41097c0 2024-09-10T07:41:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.440+0000 7fdfa2ffd640 1 --2- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdf8c039060 0x7fdf8c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.440+0000 7fdfa2ffd640 1 --2- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdf8c039060 0x7fdf8c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf980098c0 tx=0x7fdf98006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.444+0000 7fdfa0ff9640 1 -- 172.21.15.73:0/2535038677 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf940373b0 con 0x7fdfa41097c0 2024-09-10T07:41:03.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:03.612+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}) -- 0x7fdfa419a680 con 0x7fdf8c039060 2024-09-10T07:41:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:03 smithi073 ceph-mon[30850]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:05.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:05 smithi073 ceph-mon[30850]: Deploying cephadm binary to smithi159 2024-09-10T07:41:05.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:05 smithi073 ceph-mon[30850]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:05.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:05.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:05.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:05.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:05.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:41:05.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:05.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:06.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.880+0000 7fdfa0ff9640 1 -- 172.21.15.73:0/2535038677 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fdfa419a680 con 0x7fdf8c039060 2024-09-10T07:41:06.880 INFO:teuthology.orchestra.run.smithi073.stdout:Added host 'smithi159' with addr '172.21.15.159' 2024-09-10T07:41:06.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:06 smithi073 ceph-mon[30850]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-10T07:41:06.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:06 smithi073 ceph-mon[30850]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:06.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:06 smithi073 ceph-mon[30850]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:41:06.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:06 smithi073 ceph-mon[30850]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:41:06.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:06.880 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:06.881 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdf8c039060 msgr2=0x7fdf8c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 --2- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdf8c039060 0x7fdf8c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf980098c0 tx=0x7fdf98006db0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 msgr2=0x7fdfa4199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 --2- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 0x7fdfa4199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf94005e30 tx=0x7fdf9402fc10 comp rx=0 tx=0).stop 2024-09-10T07:41:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 shutdown_connections 2024-09-10T07:41:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 --2- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fdf8c039060 0x7fdf8c03b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 --2- 172.21.15.73:0/2535038677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfa41097c0 0x7fdfa4199320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 >> 172.21.15.73:0/2535038677 conn(0x7fdfa40ff480 msgr2=0x7fdfa4100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 shutdown_connections 2024-09-10T07:41:06.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:06.882+0000 7fdfa9f32640 1 -- 172.21.15.73:0/2535038677 wait complete. 2024-09-10T07:41:07.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T07:41:07.785 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:41:07.893 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:07 smithi073 ceph-mon[30850]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:07.894 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:07.894 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:07.894 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:07.894 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:08.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.211+0000 7f50f34f1640 1 -- 172.21.15.73:0/3996807381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 msgr2=0x7f50ec106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.211+0000 7f50f34f1640 1 --2- 172.21.15.73:0/3996807381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 0x7f50ec106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009880 tx=0x7f50e802a5d0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.211+0000 7f50f34f1640 1 -- 172.21.15.73:0/3996807381 shutdown_connections 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.211+0000 7f50f34f1640 1 --2- 172.21.15.73:0/3996807381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 0x7f50ec106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.211+0000 7f50f34f1640 1 -- 172.21.15.73:0/3996807381 >> 172.21.15.73:0/3996807381 conn(0x7f50ec0fc1b0 msgr2=0x7f50ec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.211+0000 7f50f34f1640 1 -- 172.21.15.73:0/3996807381 shutdown_connections 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.211+0000 7f50f34f1640 1 -- 172.21.15.73:0/3996807381 wait complete. 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.212+0000 7f50f34f1640 1 Processor -- start 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.212+0000 7f50f34f1640 1 -- start start 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.212+0000 7f50f34f1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 0x7f50ec0fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.212+0000 7f50f34f1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec10ab90 con 0x7f50ec106560 2024-09-10T07:41:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.212+0000 7f50f128d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 0x7f50ec0fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.212+0000 7f50f128d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 0x7f50ec0fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56188/0 (socket says 172.21.15.73:56188) 2024-09-10T07:41:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.212+0000 7f50f128d640 1 -- 172.21.15.73:0/1530873093 learned_addr learned my addr 172.21.15.73:0/1530873093 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:41:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.213+0000 7f50f128d640 1 -- 172.21.15.73:0/1530873093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ec0fe550 con 0x7f50ec106560 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.214+0000 7f50f128d640 1 --2- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 0x7f50ec0fc660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009230 tx=0x7f50e8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.214+0000 7f50e27fc640 1 -- 172.21.15.73:0/1530873093 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e803f070 con 0x7f50ec106560 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.214+0000 7f50e27fc640 1 -- 172.21.15.73:0/1530873093 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50e803bc80 con 0x7f50ec106560 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.214+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ec0fcba0 con 0x7f50ec106560 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.214+0000 7f50e27fc640 1 -- 172.21.15.73:0/1530873093 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e8035030 con 0x7f50ec106560 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.214+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ec0fd060 con 0x7f50ec106560 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.215+0000 7f50e27fc640 1 -- 172.21.15.73:0/1530873093 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f50e8042070 con 0x7f50ec106560 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.215+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ec101bd0 con 0x7f50ec106560 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.215+0000 7f50e27fc640 1 --2- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f50d80390c0 0x7f50d803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.215+0000 7f50e27fc640 1 -- 172.21.15.73:0/1530873093 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f50e806cd00 con 0x7f50ec106560 2024-09-10T07:41:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.215+0000 7f50f0a8c640 1 --2- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f50d80390c0 0x7f50d803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:08.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.215+0000 7f50f0a8c640 1 --2- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f50d80390c0 0x7f50d803b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0098c0 tx=0x7f50dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:08.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.220+0000 7f50e27fc640 1 -- 172.21.15.73:0/1530873093 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50e8073080 con 0x7f50ec106560 2024-09-10T07:41:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.401+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50ec0fdc00 con 0x7f50d80390c0 2024-09-10T07:41:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.403+0000 7f50e27fc640 1 -- 172.21.15.73:0/1530873093 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f50ec0fdc00 con 0x7f50d80390c0 2024-09-10T07:41:08.402 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:41:08.403 INFO:teuthology.orchestra.run.smithi073.stdout:[{"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}, {"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}, {"addr": "172.21.15.159", "hostname": "smithi159", "labels": [], "status": ""}] 2024-09-10T07:41:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f50d80390c0 msgr2=0x7f50d803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 --2- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f50d80390c0 0x7f50d803b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0098c0 tx=0x7f50dc006db0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 msgr2=0x7f50ec0fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 --2- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 0x7f50ec0fc660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009230 tx=0x7f50e8003d40 comp rx=0 tx=0).stop 2024-09-10T07:41:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 shutdown_connections 2024-09-10T07:41:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 --2- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f50d80390c0 0x7f50d803b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 --2- 172.21.15.73:0/1530873093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50ec106560 0x7f50ec0fc660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 >> 172.21.15.73:0/1530873093 conn(0x7f50ec0fc1b0 msgr2=0x7f50ec069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 shutdown_connections 2024-09-10T07:41:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:08.405+0000 7f50f34f1640 1 -- 172.21.15.73:0/1530873093 wait complete. 2024-09-10T07:41:08.949 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:08 smithi073 ceph-mon[30850]: Added host smithi159 2024-09-10T07:41:08.949 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:08 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:08.976 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T07:41:08.977 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T07:41:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:41:09.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.634+0000 7fbe1f212640 1 -- 172.21.15.73:0/1228588197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 msgr2=0x7fbe18106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:09.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.634+0000 7fbe1f212640 1 --2- 172.21.15.73:0/1228588197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 0x7fbe18106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009880 tx=0x7fbe0c02a5d0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.634+0000 7fbe1f212640 1 -- 172.21.15.73:0/1228588197 shutdown_connections 2024-09-10T07:41:09.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.634+0000 7fbe1f212640 1 --2- 172.21.15.73:0/1228588197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 0x7fbe18106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.634+0000 7fbe1f212640 1 -- 172.21.15.73:0/1228588197 >> 172.21.15.73:0/1228588197 conn(0x7fbe180fc1b0 msgr2=0x7fbe180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:09.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.634+0000 7fbe1f212640 1 -- 172.21.15.73:0/1228588197 shutdown_connections 2024-09-10T07:41:09.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.634+0000 7fbe1f212640 1 -- 172.21.15.73:0/1228588197 wait complete. 2024-09-10T07:41:09.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe1f212640 1 Processor -- start 2024-09-10T07:41:09.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe1f212640 1 -- start start 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe1f212640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 0x7fbe18197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe1f212640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1810ab90 con 0x7fbe18106560 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe1cfae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 0x7fbe18197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe1cfae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 0x7fbe18197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56202/0 (socket says 172.21.15.73:56202) 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe1cfae640 1 -- 172.21.15.73:0/2081022783 learned_addr learned my addr 172.21.15.73:0/2081022783 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe1cfae640 1 -- 172.21.15.73:0/2081022783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe18198500 con 0x7fbe18106560 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe1cfae640 1 --2- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 0x7fbe18197fc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009230 tx=0x7fbe0c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.635+0000 7fbe15ffb640 1 -- 172.21.15.73:0/2081022783 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe0c03f070 con 0x7fbe18106560 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.636+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe18198790 con 0x7fbe18106560 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.636+0000 7fbe15ffb640 1 -- 172.21.15.73:0/2081022783 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe0c03bc80 con 0x7fbe18106560 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.636+0000 7fbe15ffb640 1 -- 172.21.15.73:0/2081022783 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe0c035030 con 0x7fbe18106560 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.636+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe18198bf0 con 0x7fbe18106560 2024-09-10T07:41:09.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.637+0000 7fbe15ffb640 1 -- 172.21.15.73:0/2081022783 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbe0c042070 con 0x7fbe18106560 2024-09-10T07:41:09.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.637+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe18101bd0 con 0x7fbe18106560 2024-09-10T07:41:09.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.637+0000 7fbe15ffb640 1 --2- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbe08039060 0x7fbe0803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:09.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.637+0000 7fbe15ffb640 1 -- 172.21.15.73:0/2081022783 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbe0c06cd00 con 0x7fbe18106560 2024-09-10T07:41:09.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.637+0000 7fbe17fff640 1 --2- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbe08039060 0x7fbe0803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:09.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.637+0000 7fbe17fff640 1 --2- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbe08039060 0x7fbe0803b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe040098c0 tx=0x7fbe04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:09.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.642+0000 7fbe15ffb640 1 -- 172.21.15.73:0/2081022783 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe0c031e20 con 0x7fbe18106560 2024-09-10T07:41:09.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:09.812+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbe181069c0 con 0x7fbe18106560 2024-09-10T07:41:09.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:09 smithi073 ceph-mon[30850]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:41:09.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:09 smithi073 ceph-mon[30850]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.595+0000 7fbe15ffb640 1 -- 172.21.15.73:0/2081022783 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fbe0c0314c0 con 0x7fbe18106560 2024-09-10T07:41:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbe08039060 msgr2=0x7fbe0803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 --2- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbe08039060 0x7fbe0803b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe040098c0 tx=0x7fbe04006db0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 msgr2=0x7fbe18197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 --2- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 0x7fbe18197fc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009230 tx=0x7fbe0c003d40 comp rx=0 tx=0).stop 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 shutdown_connections 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 --2- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbe08039060 0x7fbe0803b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 --2- 172.21.15.73:0/2081022783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18106560 0x7fbe18197fc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 >> 172.21.15.73:0/2081022783 conn(0x7fbe180fc1b0 msgr2=0x7fbe180fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 shutdown_connections 2024-09-10T07:41:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:10.598+0000 7fbe1f212640 1 -- 172.21.15.73:0/2081022783 wait complete. 2024-09-10T07:41:10.913 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:10 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2081022783' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T07:41:11.203 INFO:tasks.cephadm:Adding mon.a on smithi073 2024-09-10T07:41:11.203 INFO:tasks.cephadm:Adding mon.b on smithi102 2024-09-10T07:41:11.203 INFO:tasks.cephadm:Adding mon.c on smithi159 2024-09-10T07:41:11.203 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi073:172.21.15.73=a;smithi102:172.21.15.102=b;smithi159:172.21.15.159=c' 2024-09-10T07:41:11.447 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T07:41:11.493 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T07:41:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.939+0000 7fa597375640 1 -- 172.21.15.159:0/3266960085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 msgr2=0x7fa5901044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.939+0000 7fa597375640 1 --2- 172.21.15.159:0/3266960085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 0x7fa5901044c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009880 tx=0x7fa58c02a5d0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.939+0000 7fa597375640 1 -- 172.21.15.159:0/3266960085 shutdown_connections 2024-09-10T07:41:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.939+0000 7fa597375640 1 --2- 172.21.15.159:0/3266960085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 0x7fa5901044c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.939+0000 7fa597375640 1 -- 172.21.15.159:0/3266960085 >> 172.21.15.159:0/3266960085 conn(0x7fa5900fbcd0 msgr2=0x7fa5900fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.939+0000 7fa597375640 1 -- 172.21.15.159:0/3266960085 shutdown_connections 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.939+0000 7fa597375640 1 -- 172.21.15.159:0/3266960085 wait complete. 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.940+0000 7fa597375640 1 Processor -- start 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.940+0000 7fa597375640 1 -- start start 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.940+0000 7fa597375640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 0x7fa590196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.940+0000 7fa597375640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa590107670 con 0x7fa5901020d0 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.940+0000 7fa595111640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 0x7fa590196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.940+0000 7fa595111640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 0x7fa590196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.159:46284/0 (socket says 172.21.15.159:46284) 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.940+0000 7fa595111640 1 -- 172.21.15.159:0/2867966321 learned_addr learned my addr 172.21.15.159:0/2867966321 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.940+0000 7fa595111640 1 -- 172.21.15.159:0/2867966321 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa590197250 con 0x7fa5901020d0 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.941+0000 7fa595111640 1 --2- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 0x7fa590196d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa58c004f60 tx=0x7fa58c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.941+0000 7fa5867fc640 1 -- 172.21.15.159:0/2867966321 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa58c03f070 con 0x7fa5901020d0 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.941+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa590197540 con 0x7fa5901020d0 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.941+0000 7fa5867fc640 1 -- 172.21.15.159:0/2867966321 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa58c003ad0 con 0x7fa5901020d0 2024-09-10T07:41:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.941+0000 7fa5867fc640 1 -- 172.21.15.159:0/2867966321 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa58c035030 con 0x7fa5901020d0 2024-09-10T07:41:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.941+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59019a1c0 con 0x7fa5901020d0 2024-09-10T07:41:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.942+0000 7fa5867fc640 1 -- 172.21.15.159:0/2867966321 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa58c042070 con 0x7fa5901020d0 2024-09-10T07:41:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.942+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa590107df0 con 0x7fa5901020d0 2024-09-10T07:41:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.942+0000 7fa5867fc640 1 --2- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa57c039060 0x7fa57c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.942+0000 7fa5867fc640 1 -- 172.21.15.159:0/2867966321 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa58c06ce00 con 0x7fa5901020d0 2024-09-10T07:41:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.942+0000 7fa594910640 1 --2- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa57c039060 0x7fa57c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.942+0000 7fa594910640 1 --2- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa57c039060 0x7fa57c03b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5800098c0 tx=0x7fa580006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:11.947+0000 7fa5867fc640 1 -- 172.21.15.159:0/2867966321 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa58c04c350 con 0x7fa5901020d0 2024-09-10T07:41:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2081022783' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T07:41:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:11.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:11.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:11.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:11.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:11.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:41:11.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:11.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:12.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.131+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi073:172.21.15.73=a;smithi102:172.21.15.102=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}) -- 0x7fa59002da00 con 0x7fa57c039060 2024-09-10T07:41:12.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.137+0000 7fa5867fc640 1 -- 172.21.15.159:0/2867966321 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa59002da00 con 0x7fa57c039060 2024-09-10T07:41:12.136 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mon update... 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa57c039060 msgr2=0x7fa57c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 --2- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa57c039060 0x7fa57c03b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5800098c0 tx=0x7fa580006db0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 msgr2=0x7fa590196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 --2- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 0x7fa590196d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa58c004f60 tx=0x7fa58c0048f0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 shutdown_connections 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 --2- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa57c039060 0x7fa57c03b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 --2- 172.21.15.159:0/2867966321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5901020d0 0x7fa590196d10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 >> 172.21.15.159:0/2867966321 conn(0x7fa5900fbcd0 msgr2=0x7fa5900fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 shutdown_connections 2024-09-10T07:41:12.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:12.139+0000 7fa597375640 1 -- 172.21.15.159:0/2867966321 wait complete. 2024-09-10T07:41:12.722 DEBUG:teuthology.orchestra.run.smithi102:mon.b> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T07:41:12.725 DEBUG:teuthology.orchestra.run.smithi159:mon.c> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T07:41:12.728 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T07:41:12.728 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:12.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:12.827 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:12.827 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:12.999 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.391+0000 7f235179f640 1 -- 172.21.15.159:0/643827585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 msgr2=0x7f234c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.391+0000 7f235179f640 1 --2- 172.21.15.159:0/643827585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 0x7f234c107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f233c009880 tx=0x7f233c02a5d0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.391+0000 7f235179f640 1 -- 172.21.15.159:0/643827585 shutdown_connections 2024-09-10T07:41:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.391+0000 7f235179f640 1 --2- 172.21.15.159:0/643827585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 0x7f234c107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.391+0000 7f235179f640 1 -- 172.21.15.159:0/643827585 >> 172.21.15.159:0/643827585 conn(0x7f234c0fd290 msgr2=0x7f234c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.391+0000 7f235179f640 1 -- 172.21.15.159:0/643827585 shutdown_connections 2024-09-10T07:41:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.391+0000 7f235179f640 1 -- 172.21.15.159:0/643827585 wait complete. 2024-09-10T07:41:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.391+0000 7f235179f640 1 Processor -- start 2024-09-10T07:41:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.392+0000 7f235179f640 1 -- start start 2024-09-10T07:41:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.392+0000 7f235179f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 0x7f234c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.392+0000 7f235179f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f234c10bc90 con 0x7f234c107660 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.392+0000 7f234affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 0x7f234c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.392+0000 7f234affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 0x7f234c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.159:46304/0 (socket says 172.21.15.159:46304) 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.392+0000 7f234affd640 1 -- 172.21.15.159:0/479963960 learned_addr learned my addr 172.21.15.159:0/479963960 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.392+0000 7f234affd640 1 -- 172.21.15.159:0/479963960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234c0763e0 con 0x7f234c107660 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.393+0000 7f234affd640 1 --2- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 0x7f234c0744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f233c009230 tx=0x7f233c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.393+0000 7f2348ff9640 1 -- 172.21.15.159:0/479963960 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f233c03f070 con 0x7f234c107660 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.393+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234c074a30 con 0x7f234c107660 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.393+0000 7f2348ff9640 1 -- 172.21.15.159:0/479963960 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f233c03bc80 con 0x7f234c107660 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.393+0000 7f2348ff9640 1 -- 172.21.15.159:0/479963960 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f233c035030 con 0x7f234c107660 2024-09-10T07:41:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.393+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f234c074ef0 con 0x7f234c107660 2024-09-10T07:41:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.394+0000 7f2348ff9640 1 -- 172.21.15.159:0/479963960 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f233c042070 con 0x7f234c107660 2024-09-10T07:41:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.394+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234c102cd0 con 0x7f234c107660 2024-09-10T07:41:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.394+0000 7f2348ff9640 1 --2- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2338039060 0x7f233803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.394+0000 7f2348ff9640 1 -- 172.21.15.159:0/479963960 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f233c06cdc0 con 0x7f234c107660 2024-09-10T07:41:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.394+0000 7f2343fff640 1 --2- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2338039060 0x7f233803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.395+0000 7f2343fff640 1 --2- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2338039060 0x7f233803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f23340098c0 tx=0x7f2334006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:13.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.399+0000 7f2348ff9640 1 -- 172.21.15.159:0/479963960 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f233c031e20 con 0x7f234c107660 2024-09-10T07:41:13.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.631+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f234c075a20 con 0x7f234c107660 2024-09-10T07:41:13.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.632+0000 7f2348ff9640 1 -- 172.21.15.159:0/479963960 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f233c031570 con 0x7f234c107660 2024-09-10T07:41:13.631 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:41:13.632 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","modified":"2024-09-10T07:39:56.034674Z","created":"2024-09-10T07:39:56.034674Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T07:41:13.632 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-10T07:41:13.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2338039060 msgr2=0x7f233803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 --2- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2338039060 0x7f233803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f23340098c0 tx=0x7f2334006db0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 msgr2=0x7f234c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 --2- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 0x7f234c0744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f233c009230 tx=0x7f233c003d40 comp rx=0 tx=0).stop 2024-09-10T07:41:13.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 shutdown_connections 2024-09-10T07:41:13.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 --2- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2338039060 0x7f233803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 --2- 172.21.15.159:0/479963960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f234c107660 0x7f234c0744f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 >> 172.21.15.159:0/479963960 conn(0x7f234c0fd290 msgr2=0x7f234c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:13.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 shutdown_connections 2024-09-10T07:41:13.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:13.634+0000 7f235179f640 1 -- 172.21.15.159:0/479963960 wait complete. 2024-09-10T07:41:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:41:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi073:172.21.15.73=a;smithi102:172.21.15.102=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: Saving service mon spec with placement smithi073:172.21.15.73=a;smithi102:172.21.15.102=b;smithi159:172.21.15.159=c;count:3 2024-09-10T07:41:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T07:41:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: Reconfiguring daemon mon.a on smithi073 2024-09-10T07:41:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:13.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:13.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:13.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:13.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:13.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:13.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:13.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:13.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:14.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:14 smithi073 ceph-mon[30850]: Deploying daemon mon.c on smithi159 2024-09-10T07:41:14.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:14 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/479963960' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:15.210 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T07:41:15.210 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T07:41:15.873 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:15 smithi073 ceph-mon[30850]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:15.963 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:16.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.865+0000 7fb709fce640 1 -- 172.21.15.159:0/511920806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 msgr2=0x7fb704106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.865+0000 7fb709fce640 1 --2- 172.21.15.159:0/511920806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 0x7fb704106940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009880 tx=0x7fb6f402a5d0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.866+0000 7fb709fce640 1 -- 172.21.15.159:0/511920806 shutdown_connections 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.866+0000 7fb709fce640 1 --2- 172.21.15.159:0/511920806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 0x7fb704106940 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.866+0000 7fb709fce640 1 -- 172.21.15.159:0/511920806 >> 172.21.15.159:0/511920806 conn(0x7fb7040fc1b0 msgr2=0x7fb7040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.866+0000 7fb709fce640 1 -- 172.21.15.159:0/511920806 shutdown_connections 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.866+0000 7fb709fce640 1 -- 172.21.15.159:0/511920806 wait complete. 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.866+0000 7fb709fce640 1 Processor -- start 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.866+0000 7fb709fce640 1 -- start start 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.867+0000 7fb709fce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 0x7fb704197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.867+0000 7fb709fce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb70410ab90 con 0x7fb704106560 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.867+0000 7fb7037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 0x7fb704197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.867+0000 7fb7037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 0x7fb704197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.159:41774/0 (socket says 172.21.15.159:41774) 2024-09-10T07:41:16.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.867+0000 7fb7037fe640 1 -- 172.21.15.159:0/1277586257 learned_addr learned my addr 172.21.15.159:0/1277586257 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.867+0000 7fb7037fe640 1 -- 172.21.15.159:0/1277586257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb704198470 con 0x7fb704106560 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.868+0000 7fb7037fe640 1 --2- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 0x7fb704197f30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009230 tx=0x7fb6f4003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.868+0000 7fb700ff9640 1 -- 172.21.15.159:0/1277586257 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f403f070 con 0x7fb704106560 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.868+0000 7fb700ff9640 1 -- 172.21.15.159:0/1277586257 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6f403bd40 con 0x7fb704106560 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.868+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb704198700 con 0x7fb704106560 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.868+0000 7fb700ff9640 1 -- 172.21.15.159:0/1277586257 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f4035030 con 0x7fb704106560 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.868+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb704198b60 con 0x7fb704106560 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.869+0000 7fb700ff9640 1 -- 172.21.15.159:0/1277586257 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb6f4042070 con 0x7fb704106560 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.869+0000 7fb700ff9640 1 --2- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb6ec0390c0 0x7fb6ec03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.869+0000 7fb700ff9640 1 -- 172.21.15.159:0/1277586257 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb6f406dc10 con 0x7fb704106560 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.869+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb704101bd0 con 0x7fb704106560 2024-09-10T07:41:16.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.869+0000 7fb702ffd640 1 --2- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb6ec0390c0 0x7fb6ec03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.870+0000 7fb702ffd640 1 --2- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb6ec0390c0 0x7fb6ec03b580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80098c0 tx=0x7fb6f8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:16.874+0000 7fb700ff9640 1 -- 172.21.15.159:0/1277586257 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6f4031de0 con 0x7fb704106560 2024-09-10T07:41:17.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.119+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb7041069c0 con 0x7fb704106560 2024-09-10T07:41:17.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.119+0000 7fb700ff9640 1 -- 172.21.15.159:0/1277586257 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fb6f403a8e0 con 0x7fb704106560 2024-09-10T07:41:17.119 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:41:17.119 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","modified":"2024-09-10T07:39:56.034674Z","created":"2024-09-10T07:39:56.034674Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T07:41:17.120 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-10T07:41:17.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb6ec0390c0 msgr2=0x7fb6ec03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:17.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 --2- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb6ec0390c0 0x7fb6ec03b580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80098c0 tx=0x7fb6f8006db0 comp rx=0 tx=0).stop 2024-09-10T07:41:17.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 msgr2=0x7fb704197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:17.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 --2- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 0x7fb704197f30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009230 tx=0x7fb6f4003d80 comp rx=0 tx=0).stop 2024-09-10T07:41:17.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 shutdown_connections 2024-09-10T07:41:17.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 --2- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb6ec0390c0 0x7fb6ec03b580 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:17.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 --2- 172.21.15.159:0/1277586257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb704106560 0x7fb704197f30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:17.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 >> 172.21.15.159:0/1277586257 conn(0x7fb7040fc1b0 msgr2=0x7fb7040fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:17.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 shutdown_connections 2024-09-10T07:41:17.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:17.122+0000 7fb709fce640 1 -- 172.21.15.159:0/1277586257 wait complete. 2024-09-10T07:41:17.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:17 smithi159 systemd[1]: Starting Ceph mon.c for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:41:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:17 smithi073 ceph-mon[30850]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:17 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/1277586257' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:18.112 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:17 smithi159 podman[35503]: 2024-09-10 07:41:17.862675437 +0000 UTC m=+0.105615007 container create d3abba75b6d82f134674250bcc469af4f1de1ee8fdda23bf99c858c2bfaa97a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T07:41:18.112 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:17 smithi159 podman[35503]: 2024-09-10 07:41:17.772888561 +0000 UTC m=+0.015828137 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:41:18.112 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 podman[35503]: 2024-09-10 07:41:18.080458941 +0000 UTC m=+0.323398516 container init d3abba75b6d82f134674250bcc469af4f1de1ee8fdda23bf99c858c2bfaa97a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T07:41:18.112 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 podman[35503]: 2024-09-10 07:41:18.083704788 +0000 UTC m=+0.326644360 container start d3abba75b6d82f134674250bcc469af4f1de1ee8fdda23bf99c858c2bfaa97a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T07:41:18.112 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: pidfile_write: ignore empty --pid-file 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: load: jerasure load: lrc 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: RocksDB version: 7.9.2 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Git sha 0 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: DB SUMMARY 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: DB Session ID: JKMHYB8OV7JKHNUK3X7R 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: CURRENT file: CURRENT 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T07:41:18.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-10T07:41:18.114 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-10T07:41:18.114 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.error_if_exists: 0 2024-09-10T07:41:18.114 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.create_if_missing: 0 2024-09-10T07:41:18.114 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.paranoid_checks: 1 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.env: 0x55db4a891940 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.info_log: 0x55db4be5f6e0 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.statistics: (nil) 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.use_fsync: 0 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_log_file_size: 0 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T07:41:18.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.allow_fallocate: 1 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.use_direct_reads: 0 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.db_log_dir: 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.wal_dir: 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T07:41:18.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.write_buffer_manager: 0x55db4be6edc0 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T07:41:18.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.unordered_write: 0 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.row_cache: None 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.wal_filter: None 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.two_write_queues: 0 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.wal_compression: 0 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.atomic_flush: 0 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.log_readahead_size: 0 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_background_jobs: 2 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_background_compactions: -1 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_subcompactions: 1 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T07:41:18.119 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_open_files: -1 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_background_flushes: -1 2024-09-10T07:41:18.120 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Compression algorithms supported: 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: kZSTD supported: 0 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: kXpressCompression supported: 0 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: kBZip2Compression supported: 0 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: kLZ4Compression supported: 1 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: kZlibCompression supported: 1 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: kSnappyCompression supported: 1 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.merge_operator: 2024-09-10T07:41:18.121 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_filter: None 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55db4be5f320) 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout: cache_index_and_filter_blocks: 1 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout: pin_top_level_index_and_filter: 1 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout: index_type: 0 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout: data_block_index_type: 0 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout: index_shortening: 1 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T07:41:18.122 INFO:journalctl@ceph.mon.c.smithi159.stdout: checksum: 4 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: no_block_cache: 0 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache: 0x55db4be531f0 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache_name: BinnedLRUCache 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache_options: 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: capacity : 536870912 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: num_shard_bits : 4 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: strict_capacity_limit : 0 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: high_pri_pool_ratio: 0.000 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache_compressed: (nil) 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: persistent_cache: (nil) 2024-09-10T07:41:18.123 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_size: 4096 2024-09-10T07:41:18.124 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_size_deviation: 10 2024-09-10T07:41:18.124 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_restart_interval: 16 2024-09-10T07:41:18.124 INFO:journalctl@ceph.mon.c.smithi159.stdout: index_block_restart_interval: 1 2024-09-10T07:41:18.124 INFO:journalctl@ceph.mon.c.smithi159.stdout: metadata_block_size: 4096 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: partition_filters: 0 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: use_delta_encoding: 1 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: filter_policy: bloomfilter 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: whole_key_filtering: 1 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: verify_compression: 0 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: read_amp_bytes_per_bit: 0 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: format_version: 5 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: enable_index_compression: 1 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_align: 0 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: max_auto_readahead_size: 262144 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: prepopulate_block_cache: 0 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: initial_auto_readahead_size: 8192 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T07:41:18.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression: NoCompression 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.num_levels: 7 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T07:41:18.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T07:41:18.127 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T07:41:18.128 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T07:41:18.129 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.inplace_update_support: 0 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.bloom_locality: 0 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.max_successive_merges: 0 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T07:41:18.130 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.ttl: 2592000 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.enable_blob_files: false 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.min_blob_size: 0 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T07:41:18.131 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8dac2b3c-3d4b-4e9c-b959-f5ecbf82b127 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725954078111120, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725954078111529, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725954078, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8dac2b3c-3d4b-4e9c-b959-f5ecbf82b127", "db_session_id": "JKMHYB8OV7JKHNUK3X7R", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725954078111623, "job": 1, "event": "recovery_finished"} 2024-09-10T07:41:18.132 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55db4be80e00 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: DB pointer 0x55db4bf7c000 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** DB Stats ** 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-10T07:41:18.133 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-10T07:41:18.134 INFO:journalctl@ceph.mon.c.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: Block cache BinnedLRUCache@0x55db4be531f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: using public_addr v2:172.21.15.159:0/0 -> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-09-10T07:41:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: starting mon.c rank -1 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:18.136 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(???) e0 preinit fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).mds e1 new map 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout: e1 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout: btime 2024-09-10T07:39:59:864905+0000 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout: legacy client fscid: -1 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout: No filesystems configured 2024-09-10T07:41:18.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:18.409 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Added host smithi159 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:41:18.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2081022783' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2081022783' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:18.411 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi073:172.21.15.73=a;smithi102:172.21.15.102=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:18.412 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Saving service mon spec with placement smithi073:172.21.15.73=a;smithi102:172.21.15.102=b;smithi159:172.21.15.159=c;count:3 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Reconfiguring daemon mon.a on smithi073 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: Deploying daemon mon.c on smithi159 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/479963960' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:18.413 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:18.414 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:18.414 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/1277586257' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:18.414 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 ceph-mon[35522]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T07:41:18.414 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 bash[35503]: d3abba75b6d82f134674250bcc469af4f1de1ee8fdda23bf99c858c2bfaa97a8 2024-09-10T07:41:18.414 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:18 smithi159 systemd[1]: Started Ceph mon.c for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:41:18.639 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T07:41:18.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T07:41:18.902 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:41:23.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:41:23.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: mon.a calling monitor election 2024-09-10T07:41:23.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:23.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: mon.c calling monitor election 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: monmap epoch 2 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: last_changed 2024-09-10T07:41:18.137305+0000 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: min_mon_release 19 (squid) 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: election_strategy: 1 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-10T07:41:23.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: fsmap 2024-09-10T07:41:23.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:23.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: mgrmap e13: x(active, since 38s) 2024-09-10T07:41:23.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: overall HEALTH_OK 2024-09-10T07:41:23.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:23.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:23.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:23.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:23.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:23.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:41:23.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: mon.a calling monitor election 2024-09-10T07:41:23.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:23.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: mon.c calling monitor election 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: monmap epoch 2 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: last_changed 2024-09-10T07:41:18.137305+0000 2024-09-10T07:41:23.660 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: min_mon_release 19 (squid) 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: election_strategy: 1 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: fsmap 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: mgrmap e13: x(active, since 38s) 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: overall HEALTH_OK 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:23.661 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:23.662 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:23.662 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:23.662 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:23.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.729+0000 7f5224d5c640 1 -- 172.21.15.159:0/2938513878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5208003530 msgr2=0x7f52080059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:23.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.729+0000 7f5224d5c640 1 --2- 172.21.15.159:0/2938513878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5208003530 0x7f52080059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f522006a9c0 tx=0x7f521002c490 comp rx=0 tx=0).stop 2024-09-10T07:41:23.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.729+0000 7f5224d5c640 1 -- 172.21.15.159:0/2938513878 shutdown_connections 2024-09-10T07:41:23.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.729+0000 7f5224d5c640 1 --2- 172.21.15.159:0/2938513878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5208003530 0x7f52080059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:23.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.729+0000 7f5224d5c640 1 -- 172.21.15.159:0/2938513878 >> 172.21.15.159:0/2938513878 conn(0x7f52200fc220 msgr2=0x7f52200fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:23.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.729+0000 7f5224d5c640 1 -- 172.21.15.159:0/2938513878 shutdown_connections 2024-09-10T07:41:23.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.729+0000 7f5224d5c640 1 -- 172.21.15.159:0/2938513878 wait complete. 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f5224d5c640 1 Processor -- start 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f5224d5c640 1 -- start start 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f5224d5c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 0x7f5220197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f5224d5c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201978d0 0x7f522019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f5224d5c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5220109780 con 0x7f52201978d0 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f5224d5c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5220109600 con 0x7f5208003530 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f521e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 0x7f5220197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f521e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 0x7f5220197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56276/0 (socket says 172.21.15.159:56276) 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f521e59c640 1 -- 172.21.15.159:0/1044049024 learned_addr learned my addr 172.21.15.159:0/1044049024 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:41:23.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f521e59c640 1 -- 172.21.15.159:0/1044049024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 msgr2=0x7f5220197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T07:41:23.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f521e59c640 1 -- 172.21.15.159:0/1044049024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 msgr2=0x7f5220197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T07:41:23.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.731+0000 7f521dd9b640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201978d0 0x7f522019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:23.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f521e59c640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 0x7f5220197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:41:23.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f521e59c640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 0x7f5220197390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f521dd9b640 1 -- 172.21.15.159:0/1044049024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 msgr2=0x7f5220197390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f521dd9b640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 0x7f5220197390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f521dd9b640 1 -- 172.21.15.159:0/1044049024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5220197ef0 con 0x7f52201978d0 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f521dd9b640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201978d0 0x7f522019bc60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f521400b3d0 tx=0x7f521400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f520f7fe640 1 -- 172.21.15.159:0/1044049024 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5214011630 con 0x7f52201978d0 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f520f7fe640 1 -- 172.21.15.159:0/1044049024 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5214011cb0 con 0x7f52201978d0 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522019c1a0 con 0x7f52201978d0 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f520f7fe640 1 -- 172.21.15.159:0/1044049024 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5214010df0 con 0x7f52201978d0 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.732+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522019c6e0 con 0x7f52201978d0 2024-09-10T07:41:23.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.733+0000 7f520f7fe640 1 -- 172.21.15.159:0/1044049024 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5214018020 con 0x7f52201978d0 2024-09-10T07:41:23.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.734+0000 7f520f7fe640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5200038e00 0x7f520003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:23.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.734+0000 7f520f7fe640 1 -- 172.21.15.159:0/1044049024 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f521404bde0 con 0x7f52201978d0 2024-09-10T07:41:23.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.734+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522006ac70 con 0x7f52201978d0 2024-09-10T07:41:23.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.734+0000 7f521e59c640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5200038e00 0x7f520003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:23.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.734+0000 7f521e59c640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5200038e00 0x7f520003b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5210012c10 tx=0x7f52100323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:23.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.739+0000 7f520f7fe640 1 -- 172.21.15.159:0/1044049024 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f521401f020 con 0x7f52201978d0 2024-09-10T07:41:23.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.976+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5220190f60 con 0x7f52201978d0 2024-09-10T07:41:23.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.976+0000 7f520f7fe640 1 -- 172.21.15.159:0/1044049024 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f5214018310 con 0x7f52201978d0 2024-09-10T07:41:23.976 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:41:23.976 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":2,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","modified":"2024-09-10T07:41:18.137305Z","created":"2024-09-10T07:39:56.034674Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T07:41:23.977 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 2 2024-09-10T07:41:23.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5200038e00 msgr2=0x7f520003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5200038e00 0x7f520003b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5210012c10 tx=0x7f52100323a0 comp rx=0 tx=0).stop 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201978d0 msgr2=0x7f522019bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201978d0 0x7f522019bc60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f521400b3d0 tx=0x7f521400b890 comp rx=0 tx=0).stop 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 shutdown_connections 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5200038e00 0x7f520003b2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201978d0 0x7f522019bc60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 --2- 172.21.15.159:0/1044049024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5208003530 0x7f5220197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 >> 172.21.15.159:0/1044049024 conn(0x7f52200fc220 msgr2=0x7f52200fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 shutdown_connections 2024-09-10T07:41:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:23.979+0000 7f5224d5c640 1 -- 172.21.15.159:0/1044049024 wait complete. 2024-09-10T07:41:24.287 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:24 smithi159 ceph-mon[35522]: Deploying daemon mon.b on smithi102 2024-09-10T07:41:24.287 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:24 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/1044049024' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:24.287 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:24 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:24.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:24 smithi073 ceph-mon[30850]: Deploying daemon mon.b on smithi102 2024-09-10T07:41:24.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:24 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/1044049024' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:24.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:24 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:25.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:25 smithi159 ceph-mon[35522]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:25.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:25 smithi073 ceph-mon[30850]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:25.661 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T07:41:25.662 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T07:41:25.909 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:41:26.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.328+0000 7f3edbab0640 1 -- 172.21.15.159:0/2166805649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 msgr2=0x7f3ed4102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.328+0000 7f3edbab0640 1 --2- 172.21.15.159:0/2166805649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 0x7f3ed4102c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009880 tx=0x7f3ecc02a670 comp rx=0 tx=0).stop 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.328+0000 7f3edbab0640 1 -- 172.21.15.159:0/2166805649 shutdown_connections 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.328+0000 7f3edbab0640 1 --2- 172.21.15.159:0/2166805649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 0x7f3ed4102c20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.328+0000 7f3edbab0640 1 -- 172.21.15.159:0/2166805649 >> 172.21.15.159:0/2166805649 conn(0x7f3ed40fc280 msgr2=0x7f3ed40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.329+0000 7f3edbab0640 1 -- 172.21.15.159:0/2166805649 shutdown_connections 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.329+0000 7f3edbab0640 1 -- 172.21.15.159:0/2166805649 wait complete. 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.329+0000 7f3edbab0640 1 Processor -- start 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.329+0000 7f3edbab0640 1 -- start start 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.329+0000 7f3edbab0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 0x7f3ed41974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.329+0000 7f3edbab0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed41979e0 0x7f3ed419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:26.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.329+0000 7f3edbab0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed410bdb0 con 0x7f3ed4102840 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.329+0000 7f3edbab0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed410bc30 con 0x7f3ed41979e0 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed984c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 0x7f3ed41974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed904b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed41979e0 0x7f3ed419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed984c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 0x7f3ed41974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.159:45244/0 (socket says 172.21.15.159:45244) 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed984c640 1 -- 172.21.15.159:0/76133532 learned_addr learned my addr 172.21.15.159:0/76133532 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed904b640 1 -- 172.21.15.159:0/76133532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed41979e0 msgr2=0x7f3ed419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed904b640 1 -- 172.21.15.159:0/76133532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed41979e0 msgr2=0x7f3ed419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed904b640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed41979e0 0x7f3ed419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed904b640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed41979e0 0x7f3ed419bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed984c640 1 -- 172.21.15.159:0/76133532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed41979e0 msgr2=0x7f3ed419bd20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed984c640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed41979e0 0x7f3ed419bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:26.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed984c640 1 -- 172.21.15.159:0/76133532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed4198000 con 0x7f3ed4102840 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed984c640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 0x7f3ed41974a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc032c50 tx=0x7f3ecc032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed2ffd640 1 -- 172.21.15.159:0/76133532 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3ecc035070 con 0x7f3ed4102840 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed2ffd640 1 -- 172.21.15.159:0/76133532 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ecc003ce0 con 0x7f3ed4102840 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed419c260 con 0x7f3ed4102840 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3ed2ffd640 1 -- 172.21.15.159:0/76133532 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3ecc03bc00 con 0x7f3ed4102840 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.330+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed419c740 con 0x7f3ed4102840 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.331+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed406a4f0 con 0x7f3ed4102840 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.331+0000 7f3ed2ffd640 1 -- 172.21.15.159:0/76133532 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3ecc042030 con 0x7f3ed4102840 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.332+0000 7f3ed2ffd640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3ebc038e00 0x7f3ebc03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.332+0000 7f3ed2ffd640 1 -- 172.21.15.159:0/76133532 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3ecc040070 con 0x7f3ed4102840 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.332+0000 7f3ed904b640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3ebc038e00 0x7f3ebc03b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:26.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.332+0000 7f3ed904b640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3ebc038e00 0x7f3ebc03b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80070b0 tx=0x7f3ec8007040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:26.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.337+0000 7f3ed2ffd640 1 -- 172.21.15.159:0/76133532 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ecc038350 con 0x7f3ed4102840 2024-09-10T07:41:26.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.567+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3ed419c9f0 con 0x7f3ed4102840 2024-09-10T07:41:26.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.567+0000 7f3ed2ffd640 1 -- 172.21.15.159:0/76133532 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f3ecc0433c0 con 0x7f3ed4102840 2024-09-10T07:41:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:41:26.567 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":2,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","modified":"2024-09-10T07:41:18.137305Z","created":"2024-09-10T07:39:56.034674Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T07:41:26.567 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 2 2024-09-10T07:41:26.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.569+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3ebc038e00 msgr2=0x7f3ebc03b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:26.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.569+0000 7f3edbab0640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3ebc038e00 0x7f3ebc03b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80070b0 tx=0x7f3ec8007040 comp rx=0 tx=0).stop 2024-09-10T07:41:26.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.569+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 msgr2=0x7f3ed41974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:26.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.569+0000 7f3edbab0640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 0x7f3ed41974a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc032c50 tx=0x7f3ecc032c80 comp rx=0 tx=0).stop 2024-09-10T07:41:26.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.569+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 shutdown_connections 2024-09-10T07:41:26.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.569+0000 7f3edbab0640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3ebc038e00 0x7f3ebc03b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:26.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.569+0000 7f3edbab0640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed41979e0 0x7f3ed419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:26.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.569+0000 7f3edbab0640 1 --2- 172.21.15.159:0/76133532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed4102840 0x7f3ed41974a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:26.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.570+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 >> 172.21.15.159:0/76133532 conn(0x7f3ed40fc280 msgr2=0x7f3ed4105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:26.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.570+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 shutdown_connections 2024-09-10T07:41:26.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:26.570+0000 7f3edbab0640 1 -- 172.21.15.159:0/76133532 wait complete. 2024-09-10T07:41:26.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:26 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/76133532' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:26.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:26 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/76133532' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:27.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:26 smithi102 systemd[1]: Started Ceph mon.b for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:41:28.121 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T07:41:28.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T07:41:28.372 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:41:32.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.012+0000 7f49b7d86640 1 -- 172.21.15.159:0/4099148562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 msgr2=0x7f499c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:32.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.012+0000 7f49b7d86640 1 --2- 172.21.15.159:0/4099148562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 0x7f499c0059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f49b01016c0 tx=0x7f49ac02c150 comp rx=0 tx=0).stop 2024-09-10T07:41:32.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.012+0000 7f49b7d86640 1 -- 172.21.15.159:0/4099148562 shutdown_connections 2024-09-10T07:41:32.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.012+0000 7f49b7d86640 1 --2- 172.21.15.159:0/4099148562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 0x7f499c0059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:32.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.012+0000 7f49b7d86640 1 -- 172.21.15.159:0/4099148562 >> 172.21.15.159:0/4099148562 conn(0x7f49b00fc280 msgr2=0x7f49b00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:32.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.012+0000 7f49b7d86640 1 -- 172.21.15.159:0/4099148562 shutdown_connections 2024-09-10T07:41:32.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.012+0000 7f49b7d86640 1 -- 172.21.15.159:0/4099148562 wait complete. 2024-09-10T07:41:32.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.013+0000 7f49b7d86640 1 Processor -- start 2024-09-10T07:41:32.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.013+0000 7f49b7d86640 1 -- start start 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.013+0000 7f49b7d86640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 0x7f49b0102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.013+0000 7f49b7d86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b0102750 0x7f49b0102bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.013+0000 7f49b7d86640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b01a3510 0x7f49b01a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.013+0000 7f49b7d86640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f49b0108690 con 0x7f499c003530 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.013+0000 7f49b7d86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f49b0108510 con 0x7f49b0102750 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.013+0000 7f49b7d86640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f49b0108810 con 0x7f49b01a3510 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5b22640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 0x7f49b0102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b6323640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b01a3510 0x7f49b01a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5b22640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 0x7f49b0102210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.159:45320/0 (socket says 172.21.15.159:45320) 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5b22640 1 -- 172.21.15.159:0/3540129320 learned_addr learned my addr 172.21.15.159:0/3540129320 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5321640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b0102750 0x7f49b0102bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b6323640 1 -- 172.21.15.159:0/3540129320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b01a3510 msgr2=0x7f49b01a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-10T07:41:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b6323640 1 -- 172.21.15.159:0/3540129320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b01a3510 msgr2=0x7f49b01a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b6323640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b01a3510 0x7f49b01a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b6323640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b01a3510 0x7f49b01a5900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5321640 1 -- 172.21.15.159:0/3540129320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b0102750 msgr2=0x7f49b0102bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5321640 1 -- 172.21.15.159:0/3540129320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b0102750 msgr2=0x7f49b0102bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5321640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b0102750 0x7f49b0102bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5321640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b0102750 0x7f49b0102bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5b22640 1 -- 172.21.15.159:0/3540129320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b01a3510 msgr2=0x7f49b01a5900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5b22640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b01a3510 0x7f49b01a5900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5b22640 1 -- 172.21.15.159:0/3540129320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b0102750 msgr2=0x7f49b0102bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5b22640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b0102750 0x7f49b0102bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5b22640 1 -- 172.21.15.159:0/3540129320 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b01a5fd0 con 0x7f499c003530 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b5b22640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 0x7f49b0102210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49ac004dd0 tx=0x7f49ac004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49a6ffd640 1 -- 172.21.15.159:0/3540129320 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac032040 con 0x7f499c003530 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49a6ffd640 1 -- 172.21.15.159:0/3540129320 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49ac043070 con 0x7f499c003530 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b01a6260 con 0x7f499c003530 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.014+0000 7f49a6ffd640 1 -- 172.21.15.159:0/3540129320 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac036630 con 0x7f499c003530 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.015+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b01a67f0 con 0x7f499c003530 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.015+0000 7f49a6ffd640 1 -- 172.21.15.159:0/3540129320 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f49ac0367f0 con 0x7f499c003530 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.016+0000 7f49a6ffd640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f49940394f0 0x7f499403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.016+0000 7f49a6ffd640 1 -- 172.21.15.159:0/3540129320 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f49ac06ef50 con 0x7f499c003530 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.016+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b01097c0 con 0x7f499c003530 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.016+0000 7f49b5321640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f49940394f0 0x7f499403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.016+0000 7f49b5321640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f49940394f0 0x7f499403b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f49a0006fd0 tx=0x7f49a0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:32.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.021+0000 7f49a6ffd640 1 -- 172.21.15.159:0/3540129320 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49ac045bd0 con 0x7f499c003530 2024-09-10T07:41:32.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.268+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f49b01a6af0 con 0x7f499c003530 2024-09-10T07:41:32.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.269+0000 7f49a6ffd640 1 -- 172.21.15.159:0/3540129320 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f49ac0052f0 con 0x7f499c003530 2024-09-10T07:41:32.269 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:41:32.269 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: mon.a calling monitor election 2024-09-10T07:41:32.269 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: mon.c calling monitor election 2024-09-10T07:41:32.269 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.269 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:32.269 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: monmap epoch 3 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: last_changed 2024-09-10T07:41:26.918048+0000 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: min_mon_release 19 (squid) 2024-09-10T07:41:32.270 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: election_strategy: 1 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: 2: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: fsmap 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: mgrmap e13: x(active, since 47s) 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: overall HEALTH_OK 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:32.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:32.271 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:41:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":3,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","modified":"2024-09-10T07:41:26.918048Z","created":"2024-09-10T07:39:56.034674Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T07:41:32.272 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 3 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f49940394f0 msgr2=0x7f499403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f49940394f0 0x7f499403b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f49a0006fd0 tx=0x7f49a0008040 comp rx=0 tx=0).stop 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 msgr2=0x7f49b0102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 0x7f49b0102210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49ac004dd0 tx=0x7f49ac004e00 comp rx=0 tx=0).stop 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 shutdown_connections 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f49940394f0 0x7f499403b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b01a3510 0x7f49b01a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b0102750 0x7f49b0102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 --2- 172.21.15.159:0/3540129320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f499c003530 0x7f49b0102210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 >> 172.21.15.159:0/3540129320 conn(0x7f49b00fc280 msgr2=0x7f49b006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:32.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 shutdown_connections 2024-09-10T07:41:32.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:32.271+0000 7f49b7d86640 1 -- 172.21.15.159:0/3540129320 wait complete. 2024-09-10T07:41:32.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: mon.a calling monitor election 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: mon.c calling monitor election 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:32.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: monmap epoch 3 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: last_changed 2024-09-10T07:41:26.918048+0000 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: min_mon_release 19 (squid) 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: election_strategy: 1 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:41:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-10T07:41:32.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: 2: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-09-10T07:41:32.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: fsmap 2024-09-10T07:41:32.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:32.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: mgrmap e13: x(active, since 47s) 2024-09-10T07:41:32.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: overall HEALTH_OK 2024-09-10T07:41:32.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:32.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:32.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:32.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:32.786 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T07:41:32.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T07:41:33.043 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:41:33.164 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:33.165 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:32 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/3540129320' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:33.165 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:32 smithi073 ceph-mon[30850]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:33.165 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:33.244 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:33.244 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:32 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/3540129320' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:33.244 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:32 smithi159 ceph-mon[35522]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:33.244 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.522+0000 7f6eb1f76640 1 -- 172.21.15.73:0/2809504658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac106650 msgr2=0x7f6eac106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.522+0000 7f6eb1f76640 1 --2- 172.21.15.73:0/2809504658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac106650 0x7f6eac106a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009880 tx=0x7f6e9c02a5d0 comp rx=0 tx=0).stop 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.522+0000 7f6eb1f76640 1 -- 172.21.15.73:0/2809504658 shutdown_connections 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.522+0000 7f6eb1f76640 1 --2- 172.21.15.73:0/2809504658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac106650 0x7f6eac106a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.522+0000 7f6eb1f76640 1 -- 172.21.15.73:0/2809504658 >> 172.21.15.73:0/2809504658 conn(0x7f6eac0fc280 msgr2=0x7f6eac0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.522+0000 7f6eb1f76640 1 -- 172.21.15.73:0/2809504658 shutdown_connections 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.522+0000 7f6eb1f76640 1 -- 172.21.15.73:0/2809504658 wait complete. 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.522+0000 7f6eb1f76640 1 Processor -- start 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eb1f76640 1 -- start start 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eb1f76640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eac106650 0x7f6eac198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eb1f76640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eac198890 0x7f6eac198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eb1f76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1a13c0 0x7f6eac1a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eb1f76640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac10ac30 con 0x7f6eac1a13c0 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eb1f76640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac10aab0 con 0x7f6eac106650 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eb1f76640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac10adb0 con 0x7f6eac198890 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eabfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1a13c0 0x7f6eac1a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eabfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1a13c0 0x7f6eac1a37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53490/0 (socket says 172.21.15.73:53490) 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eabfff640 1 -- 172.21.15.73:0/10475636 learned_addr learned my addr 172.21.15.73:0/10475636 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6ea3fff640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eac198890 0x7f6eac198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eab7fe640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eac106650 0x7f6eac198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eab7fe640 1 -- 172.21.15.73:0/10475636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eac106650 msgr2=0x7f6eac198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eab7fe640 1 -- 172.21.15.73:0/10475636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eac106650 msgr2=0x7f6eac198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eab7fe640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eac106650 0x7f6eac198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:41:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eab7fe640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eac106650 0x7f6eac198350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eabfff640 1 -- 172.21.15.73:0/10475636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eac198890 msgr2=0x7f6eac198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eabfff640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eac198890 0x7f6eac198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eabfff640 1 -- 172.21.15.73:0/10475636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eac106650 msgr2=0x7f6eac198350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eabfff640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eac106650 0x7f6eac198350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eabfff640 1 -- 172.21.15.73:0/10475636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eac1a3f50 con 0x7f6eac1a13c0 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.523+0000 7f6eabfff640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1a13c0 0x7f6eac1a37b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400ba50 tx=0x7f6ea400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.524+0000 7f6ea97fa640 1 -- 172.21.15.73:0/10475636 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4019070 con 0x7f6eac1a13c0 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.524+0000 7f6ea97fa640 1 -- 172.21.15.73:0/10475636 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ea400cbe0 con 0x7f6eac1a13c0 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.524+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eac1a4240 con 0x7f6eac1a13c0 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.524+0000 7f6ea97fa640 1 -- 172.21.15.73:0/10475636 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40076a0 con 0x7f6eac1a13c0 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.524+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eac1a4780 con 0x7f6eac1a13c0 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.525+0000 7f6ea97fa640 1 -- 172.21.15.73:0/10475636 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6ea401c070 con 0x7f6eac1a13c0 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.525+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eac106ab0 con 0x7f6eac1a13c0 2024-09-10T07:41:33.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.525+0000 7f6ea97fa640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e980394f0 0x7f6e9803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:33.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.525+0000 7f6ea97fa640 1 -- 172.21.15.73:0/10475636 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6ea404ba50 con 0x7f6eac1a13c0 2024-09-10T07:41:33.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.525+0000 7f6eab7fe640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e980394f0 0x7f6e9803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:33.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.526+0000 7f6eab7fe640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e980394f0 0x7f6e9803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c031550 tx=0x7f6e9c0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:33.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.530+0000 7f6ea97fa640 1 -- 172.21.15.73:0/10475636 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ea40112a0 con 0x7f6eac1a13c0 2024-09-10T07:41:33.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.812+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f6eac1a4b10 con 0x7f6eac1a13c0 2024-09-10T07:41:33.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.812+0000 7f6ea97fa640 1 -- 172.21.15.73:0/10475636 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f6ea400e090 con 0x7f6eac1a13c0 2024-09-10T07:41:33.812 INFO:teuthology.orchestra.run.smithi073.stdout:# minimal ceph.conf for c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:33.812 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-10T07:41:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: mon_host = [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-09-10T07:41:33.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.814+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e980394f0 msgr2=0x7f6e9803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:33.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.814+0000 7f6eb1f76640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e980394f0 0x7f6e9803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c031550 tx=0x7f6e9c0058b0 comp rx=0 tx=0).stop 2024-09-10T07:41:33.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1a13c0 msgr2=0x7f6eac1a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:33.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1a13c0 0x7f6eac1a37b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400ba50 tx=0x7f6ea400bf10 comp rx=0 tx=0).stop 2024-09-10T07:41:33.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 shutdown_connections 2024-09-10T07:41:33.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e980394f0 0x7f6e9803b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:33.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1a13c0 0x7f6eac1a37b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:33.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eac198890 0x7f6eac198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:33.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 --2- 172.21.15.73:0/10475636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eac106650 0x7f6eac198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:33.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 >> 172.21.15.73:0/10475636 conn(0x7f6eac0fc280 msgr2=0x7f6eac0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:33.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 shutdown_connections 2024-09-10T07:41:33.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:33.815+0000 7f6eb1f76640 1 -- 172.21.15.73:0/10475636 wait complete. 2024-09-10T07:41:34.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:41:34.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: mon.a calling monitor election 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: mon.c calling monitor election 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: monmap epoch 3 2024-09-10T07:41:34.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:34.378 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: last_changed 2024-09-10T07:41:26.918048+0000 2024-09-10T07:41:34.378 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:41:34.378 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: min_mon_release 19 (squid) 2024-09-10T07:41:34.378 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: election_strategy: 1 2024-09-10T07:41:34.378 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:41:34.378 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-10T07:41:34.378 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: 2: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-09-10T07:41:34.378 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: fsmap 2024-09-10T07:41:34.378 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: mgrmap e13: x(active, since 47s) 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: overall HEALTH_OK 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='client.? 172.21.15.159:0/3540129320' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:34.379 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:34.594 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: mon.b calling monitor election 2024-09-10T07:41:34.594 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: mon.b calling monitor election 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: mon.a calling monitor election 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: mon.c calling monitor election 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: monmap epoch 3 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: last_changed 2024-09-10T07:41:26.918048+0000 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: min_mon_release 19 (squid) 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: election_strategy: 1 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:41:34.595 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-10T07:41:34.596 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: 2: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-09-10T07:41:34.596 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: fsmap 2024-09-10T07:41:34.596 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:34.596 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: mgrmap e13: x(active, since 49s) 2024-09-10T07:41:34.596 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: overall HEALTH_OK 2024-09-10T07:41:34.597 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.597 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.597 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.597 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.597 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.597 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.598 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.598 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:34.598 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:34.598 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:34.635 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T07:41:34.636 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:41:34.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T07:41:34.663 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:41:34.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:41:34.728 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:41:34.728 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T07:41:34.751 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: mon.b calling monitor election 2024-09-10T07:41:34.751 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: mon.b calling monitor election 2024-09-10T07:41:34.751 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: mon.a calling monitor election 2024-09-10T07:41:34.751 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: mon.c calling monitor election 2024-09-10T07:41:34.752 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T07:41:34.752 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: monmap epoch 3 2024-09-10T07:41:34.752 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:34.752 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: last_changed 2024-09-10T07:41:26.918048+0000 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: min_mon_release 19 (squid) 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: election_strategy: 1 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: 2: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: fsmap 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: mgrmap e13: x(active, since 49s) 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: overall HEALTH_OK 2024-09-10T07:41:34.753 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:34.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:34.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:34.755 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:41:34.756 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:41:34.824 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:41:34.824 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T07:41:34.847 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: mon.b calling monitor election 2024-09-10T07:41:34.847 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: mon.b calling monitor election 2024-09-10T07:41:34.847 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: mon.a calling monitor election 2024-09-10T07:41:34.847 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: mon.c calling monitor election 2024-09-10T07:41:34.847 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T07:41:34.847 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: monmap epoch 3 2024-09-10T07:41:34.847 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:41:34.847 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: last_changed 2024-09-10T07:41:26.918048+0000 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: created 2024-09-10T07:39:56.034674+0000 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: min_mon_release 19 (squid) 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: election_strategy: 1 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: 2: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: fsmap 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: mgrmap e13: x(active, since 49s) 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: overall HEALTH_OK 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.848 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.849 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.849 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.849 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.849 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:34.849 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:34.849 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:34.849 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:34.852 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:41:34.852 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:41:34.918 INFO:tasks.cephadm:Adding mgr.x on smithi073 2024-09-10T07:41:34.918 INFO:tasks.cephadm:Adding mgr.y on smithi102 2024-09-10T07:41:34.918 INFO:tasks.cephadm:Adding mgr.z on smithi159 2024-09-10T07:41:34.918 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi073=x;smithi102=y;smithi159=z' 2024-09-10T07:41:35.192 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:41:35.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.590+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/147976077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec81016e0 msgr2=0x7f2ec8101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:35.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.590+0000 7f2ecf0f0640 1 --2- 172.21.15.159:0/147976077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec81016e0 0x7f2ec8101ae0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009880 tx=0x7f2ec402a5d0 comp rx=0 tx=0).stop 2024-09-10T07:41:35.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.590+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/147976077 shutdown_connections 2024-09-10T07:41:35.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.590+0000 7f2ecf0f0640 1 --2- 172.21.15.159:0/147976077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec81016e0 0x7f2ec8101ae0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.590+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/147976077 >> 172.21.15.159:0/147976077 conn(0x7f2ec80fce90 msgr2=0x7f2ec80ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.590+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/147976077 shutdown_connections 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.590+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/147976077 wait complete. 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecf0f0640 1 Processor -- start 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecf0f0640 1 -- start start 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecf0f0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ec81016e0 0x7f2ec8196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecf0f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ec8197510 0x7f2ec819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecf0f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec8197990 0x7f2ec819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecf0f0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec81077d0 con 0x7f2ec8197990 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecf0f0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec8107650 con 0x7f2ec8197510 2024-09-10T07:41:35.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecf0f0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec8107950 con 0x7f2ec81016e0 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecce8c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ec81016e0 0x7f2ec8196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecce8c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ec81016e0 0x7f2ec8196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43732/0 (socket says 172.21.15.159:43732) 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecce8c640 1 -- 172.21.15.159:0/3876444456 learned_addr learned my addr 172.21.15.159:0/3876444456 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ecd68d640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec8197990 0x7f2ec819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.591+0000 7f2ebffff640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ec8197510 0x7f2ec819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ecce8c640 1 -- 172.21.15.159:0/3876444456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ec8197510 msgr2=0x7f2ec819c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ecce8c640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ec8197510 0x7f2ec819c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ecce8c640 1 -- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec8197990 msgr2=0x7f2ec819eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ecce8c640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec8197990 0x7f2ec819eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ecce8c640 1 -- 172.21.15.159:0/3876444456 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec819f3d0 con 0x7f2ec81016e0 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ebffff640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ec8197510 0x7f2ec819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ecce8c640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ec81016e0 0x7f2ec8196fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4031610 tx=0x7f2ec40043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ebdffb640 1 -- 172.21.15.159:0/3876444456 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec403f030 con 0x7f2ec81016e0 2024-09-10T07:41:35.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ebdffb640 1 -- 172.21.15.159:0/3876444456 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ec4003ce0 con 0x7f2ec81016e0 2024-09-10T07:41:35.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec819f660 con 0x7f2ec81016e0 2024-09-10T07:41:35.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ebdffb640 1 -- 172.21.15.159:0/3876444456 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4035070 con 0x7f2ec81016e0 2024-09-10T07:41:35.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.592+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec819fbc0 con 0x7f2ec81016e0 2024-09-10T07:41:35.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.593+0000 7f2ebdffb640 1 -- 172.21.15.159:0/3876444456 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2ec4042030 con 0x7f2ec81016e0 2024-09-10T07:41:35.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.593+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec8190590 con 0x7f2ec81016e0 2024-09-10T07:41:35.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.593+0000 7f2ebdffb640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2eb00394f0 0x7f2eb003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:35.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.593+0000 7f2ebdffb640 1 -- 172.21.15.159:0/3876444456 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2ec406cb20 con 0x7f2ec81016e0 2024-09-10T07:41:35.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.594+0000 7f2ebffff640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2eb00394f0 0x7f2eb003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:35.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.594+0000 7f2ebffff640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2eb00394f0 0x7f2eb003b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8006fd0 tx=0x7f2eb8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:35.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.598+0000 7f2ebdffb640 1 -- 172.21.15.159:0/3876444456 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ec403bde0 con 0x7f2ec81016e0 2024-09-10T07:41:35.684 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:35 smithi073 ceph-mon[30850]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:35.684 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:35 smithi073 ceph-mon[30850]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:35.684 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:35 smithi073 ceph-mon[30850]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:35.684 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:35 smithi073 ceph-mon[30850]: Reconfiguring mon.a (monmap changed)... 2024-09-10T07:41:35.684 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:35 smithi073 ceph-mon[30850]: Reconfiguring daemon mon.a on smithi073 2024-09-10T07:41:35.684 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:35 smithi073 ceph-mon[30850]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:35.684 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:35 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:35.684 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:35 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:35.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.782+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi102=y;smithi159=z", "target": ["mon-mgr", ""]}) -- 0x7f2ec80626c0 con 0x7f2eb00394f0 2024-09-10T07:41:35.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.788+0000 7f2ebdffb640 1 -- 172.21.15.159:0/3876444456 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2ec80626c0 con 0x7f2eb00394f0 2024-09-10T07:41:35.788 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mgr update... 2024-09-10T07:41:35.790 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2eb00394f0 msgr2=0x7f2eb003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:35.790 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2eb00394f0 0x7f2eb003b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8006fd0 tx=0x7f2eb8008040 comp rx=0 tx=0).stop 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ec81016e0 msgr2=0x7f2ec8196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ec81016e0 0x7f2ec8196fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4031610 tx=0x7f2ec40043c0 comp rx=0 tx=0).stop 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 shutdown_connections 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2eb00394f0 0x7f2eb003b9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec8197990 0x7f2ec819eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ec8197510 0x7f2ec819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 --2- 172.21.15.159:0/3876444456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ec81016e0 0x7f2ec8196fd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 >> 172.21.15.159:0/3876444456 conn(0x7f2ec80fce90 msgr2=0x7f2ec80fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 shutdown_connections 2024-09-10T07:41:35.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:41:35.791+0000 7f2ecf0f0640 1 -- 172.21.15.159:0/3876444456 wait complete. 2024-09-10T07:41:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:35 smithi159 ceph-mon[35522]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:35 smithi159 ceph-mon[35522]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:35 smithi159 ceph-mon[35522]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:35 smithi159 ceph-mon[35522]: Reconfiguring mon.a (monmap changed)... 2024-09-10T07:41:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:35 smithi159 ceph-mon[35522]: Reconfiguring daemon mon.a on smithi073 2024-09-10T07:41:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:35 smithi159 ceph-mon[35522]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:35.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:35 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:35.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:35 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:36.099 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:35 smithi102 ceph-mon[35514]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:36.099 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:35 smithi102 ceph-mon[35514]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:36.099 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:35 smithi102 ceph-mon[35514]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:41:36.100 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:35 smithi102 ceph-mon[35514]: Reconfiguring mon.a (monmap changed)... 2024-09-10T07:41:36.100 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:35 smithi102 ceph-mon[35514]: Reconfiguring daemon mon.a on smithi073 2024-09-10T07:41:36.100 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:35 smithi102 ceph-mon[35514]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:36.100 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:35 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:36.100 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:35 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:41:36.337 DEBUG:teuthology.orchestra.run.smithi102:mgr.y> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T07:41:36.339 DEBUG:teuthology.orchestra.run.smithi159:mgr.z> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T07:41:36.342 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T07:41:36.342 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:41:36.342 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T07:41:36.362 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T07:41:36.362 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-10T07:41:36.420 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T07:41:36.420 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:36.420 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T07:41:36.421 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:36.421 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:36.421 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-10 07:40:55.376677647 +0000 2024-09-10T07:41:36.421 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 07:36:40.255093748 +0000 2024-09-10T07:41:36.421 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 07:36:40.255093748 +0000 2024-09-10T07:41:36.421 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-10 07:36:40.255093748 +0000 2024-09-10T07:41:36.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T07:41:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-10T07:41:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-10T07:41:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000212569 s, 2.4 MB/s 2024-09-10T07:41:36.490 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T07:41:36.548 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-10T07:41:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T07:41:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:36.605 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T07:41:36.605 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:36.605 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:36.606 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-10 07:40:55.404676993 +0000 2024-09-10T07:41:36.606 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 07:36:40.575086307 +0000 2024-09-10T07:41:36.606 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 07:36:40.575086307 +0000 2024-09-10T07:41:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-10 07:36:40.575086307 +0000 2024-09-10T07:41:36.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T07:41:36.672 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-10T07:41:36.672 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-10T07:41:36.672 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000283716 s, 1.8 MB/s 2024-09-10T07:41:36.673 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T07:41:36.731 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-10T07:41:36.735 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:36.735 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:36.736 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:36 smithi073 ceph-mon[30850]: Reconfiguring mon.b (monmap changed)... 2024-09-10T07:41:36.736 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:36.736 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:36.736 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:36.736 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:36 smithi073 ceph-mon[30850]: Reconfiguring daemon mon.b on smithi102 2024-09-10T07:41:36.736 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T07:41:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:36.752 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T07:41:36.752 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:36.752 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:36.752 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-10 07:40:55.433676316 +0000 2024-09-10T07:41:36.752 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 07:36:40.901078727 +0000 2024-09-10T07:41:36.752 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 07:36:40.901078727 +0000 2024-09-10T07:41:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-10 07:36:40.901078727 +0000 2024-09-10T07:41:36.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T07:41:36.817 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-10T07:41:36.817 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-10T07:41:36.817 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000190655 s, 2.7 MB/s 2024-09-10T07:41:36.818 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T07:41:36.875 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-10T07:41:36.931 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T07:41:36.931 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:36.931 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-10T07:41:36.931 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:36.931 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:36.931 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-10 07:40:55.461675662 +0000 2024-09-10T07:41:36.932 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 07:36:41.242070797 +0000 2024-09-10T07:41:36.932 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 07:36:41.242070797 +0000 2024-09-10T07:41:36.932 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-10 07:36:41.242070797 +0000 2024-09-10T07:41:36.932 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T07:41:36.994 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-10T07:41:36.994 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-10T07:41:36.995 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000200873 s, 2.5 MB/s 2024-09-10T07:41:36.996 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T07:41:37.004 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:37.004 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:37.004 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:36 smithi102 ceph-mon[35514]: Reconfiguring mon.b (monmap changed)... 2024-09-10T07:41:37.004 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:37.004 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:37.004 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:37.004 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:36 smithi102 ceph-mon[35514]: Reconfiguring daemon mon.b on smithi102 2024-09-10T07:41:37.004 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:37.053 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-10T07:41:37.053 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T07:41:37.069 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T07:41:37.070 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-10T07:41:37.124 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T07:41:37.124 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:37.124 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-10T07:41:37.125 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:37.125 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:37.125 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-10 07:41:26.370021417 +0000 2024-09-10T07:41:37.125 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-10 07:36:54.023487300 +0000 2024-09-10T07:41:37.125 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-10 07:36:54.023487300 +0000 2024-09-10T07:41:37.125 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-10 07:36:54.023487300 +0000 2024-09-10T07:41:37.125 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T07:41:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:36 smithi159 ceph-mon[35522]: Reconfiguring mon.b (monmap changed)... 2024-09-10T07:41:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:37.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:36 smithi159 ceph-mon[35522]: Reconfiguring daemon mon.b on smithi102 2024-09-10T07:41:37.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-10T07:41:37.189 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-10T07:41:37.189 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000243381 s, 2.1 MB/s 2024-09-10T07:41:37.190 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T07:41:37.246 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-10T07:41:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T07:41:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:37.302 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-10T07:41:37.302 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:37.302 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:37.302 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-10 07:41:26.371021397 +0000 2024-09-10T07:41:37.302 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-10 07:36:54.354480508 +0000 2024-09-10T07:41:37.302 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-10 07:36:54.354480508 +0000 2024-09-10T07:41:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-10 07:36:54.354480508 +0000 2024-09-10T07:41:37.302 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T07:41:37.365 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-10T07:41:37.365 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-10T07:41:37.365 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000234015 s, 2.2 MB/s 2024-09-10T07:41:37.367 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T07:41:37.423 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-10T07:41:37.478 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T07:41:37.479 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:37.479 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T07:41:37.479 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:37.479 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:37.479 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-10 07:41:26.371021397 +0000 2024-09-10T07:41:37.479 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-10 07:36:54.677473880 +0000 2024-09-10T07:41:37.479 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-10 07:36:54.677473880 +0000 2024-09-10T07:41:37.479 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-10 07:36:54.677473880 +0000 2024-09-10T07:41:37.479 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T07:41:37.542 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-10T07:41:37.542 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-10T07:41:37.542 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000178169 s, 2.9 MB/s 2024-09-10T07:41:37.543 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T07:41:37.599 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-10T07:41:37.654 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T07:41:37.654 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:37.654 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T07:41:37.654 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:37.654 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:37.654 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-10 07:41:26.371021397 +0000 2024-09-10T07:41:37.655 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-10 07:36:55.000467251 +0000 2024-09-10T07:41:37.655 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-10 07:36:55.000467251 +0000 2024-09-10T07:41:37.655 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-10 07:36:55.000467251 +0000 2024-09-10T07:41:37.655 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T07:41:37.717 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-10T07:41:37.718 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-10T07:41:37.718 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000193291 s, 2.6 MB/s 2024-09-10T07:41:37.719 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T07:41:37.775 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T07:41:37.775 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T07:41:37.791 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T07:41:37.791 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-09-10T07:41:37.846 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T07:41:37.846 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:37.846 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T07:41:37.847 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:37.847 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:37.847 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-10 07:41:17.253360874 +0000 2024-09-10T07:41:37.847 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-10 07:36:57.521748024 +0000 2024-09-10T07:41:37.847 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-10 07:36:57.521748024 +0000 2024-09-10T07:41:37.847 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-10 07:36:57.521748024 +0000 2024-09-10T07:41:37.847 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T07:41:37.910 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-10T07:41:37.910 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-10T07:41:37.910 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000253011 s, 2.0 MB/s 2024-09-10T07:41:37.911 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T07:41:37.968 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-09-10T07:41:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T07:41:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:38.025 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T07:41:38.025 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:38.025 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:38.025 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-10 07:41:17.254360854 +0000 2024-09-10T07:41:38.025 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-10 07:36:57.850741632 +0000 2024-09-10T07:41:38.025 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-10 07:36:57.850741632 +0000 2024-09-10T07:41:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-10 07:36:57.850741632 +0000 2024-09-10T07:41:38.026 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T07:41:38.086 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:37 smithi159 ceph-mon[35522]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi102=y;smithi159=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:38.086 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:37 smithi159 ceph-mon[35522]: Saving service mgr spec with placement smithi073=x;smithi102=y;smithi159=z;count:3 2024-09-10T07:41:38.086 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:37 smithi159 ceph-mon[35522]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:38.086 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:38.086 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:38.086 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:38.086 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:38.087 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:38.088 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-10T07:41:38.088 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-10T07:41:38.088 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000245056 s, 2.1 MB/s 2024-09-10T07:41:38.090 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T07:41:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:37 smithi102 ceph-mon[35514]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi102=y;smithi159=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:37 smithi102 ceph-mon[35514]: Saving service mgr spec with placement smithi073=x;smithi102=y;smithi159=z;count:3 2024-09-10T07:41:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:37 smithi102 ceph-mon[35514]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:38.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:38.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:38.146 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-09-10T07:41:38.203 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T07:41:38.203 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:38.203 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T07:41:38.203 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:38.203 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:38.203 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-10 07:41:17.254360854 +0000 2024-09-10T07:41:38.203 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-10 07:36:58.197734890 +0000 2024-09-10T07:41:38.203 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-10 07:36:58.197734890 +0000 2024-09-10T07:41:38.204 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-10 07:36:58.197734890 +0000 2024-09-10T07:41:38.204 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T07:41:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:37 smithi073 ceph-mon[30850]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi102=y;smithi159=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:37 smithi073 ceph-mon[30850]: Saving service mgr spec with placement smithi073=x;smithi102=y;smithi159=z;count:3 2024-09-10T07:41:38.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:37 smithi073 ceph-mon[30850]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:38.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:38.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:38.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T07:41:38.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T07:41:38.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:38.267 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-10T07:41:38.267 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-10T07:41:38.267 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000213553 s, 2.4 MB/s 2024-09-10T07:41:38.269 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T07:41:38.325 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-09-10T07:41:38.382 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T07:41:38.382 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:41:38.382 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T07:41:38.382 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:41:38.382 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:41:38.382 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-10 07:41:17.254360854 +0000 2024-09-10T07:41:38.382 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-10 07:36:58.532728382 +0000 2024-09-10T07:41:38.382 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-10 07:36:58.532728382 +0000 2024-09-10T07:41:38.382 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-10 07:36:58.532728382 +0000 2024-09-10T07:41:38.382 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T07:41:38.446 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-10T07:41:38.446 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-10T07:41:38.446 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000183462 s, 2.8 MB/s 2024-09-10T07:41:38.448 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T07:41:38.504 INFO:tasks.cephadm:Deploying osd.0 on smithi073 with /dev/vg_nvme/lv_4... 2024-09-10T07:41:38.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T07:41:38.751 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:41:38.868 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: Reconfiguring mon.c (monmap changed)... 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: Reconfiguring daemon mon.c on smithi159 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T07:41:38.869 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:39.037 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: Reconfiguring mon.c (monmap changed)... 2024-09-10T07:41:39.094 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: Reconfiguring daemon mon.c on smithi159 2024-09-10T07:41:39.094 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:39.094 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:39.094 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:39.094 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:39.094 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:39.095 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:39.095 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T07:41:39.095 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T07:41:39.095 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T07:41:39.095 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: Reconfiguring mon.c (monmap changed)... 2024-09-10T07:41:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: Reconfiguring daemon mon.c on smithi159 2024-09-10T07:41:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:39.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:39.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:39.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:39.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T07:41:39.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T07:41:39.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T07:41:39.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:39.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:39 smithi159 ceph-mon[35522]: Deploying daemon mgr.z on smithi159 2024-09-10T07:41:39.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:39 smithi159 ceph-mon[35522]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:40.068 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:39 smithi073 ceph-mon[30850]: Deploying daemon mgr.z on smithi159 2024-09-10T07:41:40.069 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:39 smithi073 ceph-mon[30850]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:40.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:39 smithi102 ceph-mon[35514]: Deploying daemon mgr.z on smithi159 2024-09-10T07:41:40.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:39 smithi102 ceph-mon[35514]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:40.367 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 systemd[1]: Starting Ceph mgr.z for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:41:40.657 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 podman[37304]: 2024-09-10 07:41:40.368728699 +0000 UTC m=+0.104972802 container create 5f1653ae19b5bd080f2cbec21ce84898748cfde94fa9da92327bd229bece17b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T07:41:40.658 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 podman[37304]: 2024-09-10 07:41:40.27921914 +0000 UTC m=+0.015463264 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:41:40.658 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 podman[37304]: 2024-09-10 07:41:40.587689299 +0000 UTC m=+0.323933403 container init 5f1653ae19b5bd080f2cbec21ce84898748cfde94fa9da92327bd229bece17b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T07:41:40.658 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 podman[37304]: 2024-09-10 07:41:40.590335204 +0000 UTC m=+0.326579308 container start 5f1653ae19b5bd080f2cbec21ce84898748cfde94fa9da92327bd229bece17b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T07:41:40.658 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 ceph-mgr[37324]: -- 172.21.15.159:0/768921205 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a04436f0e0 con 0x55a04434d400 2024-09-10T07:41:40.989 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 bash[37304]: 5f1653ae19b5bd080f2cbec21ce84898748cfde94fa9da92327bd229bece17b7 2024-09-10T07:41:40.989 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 systemd[1]: Started Ceph mgr.z for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:41:40.989 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:40.712+0000 7fea42e99040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:41:40.989 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:40.774+0000 7fea42e99040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:41:40.989 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:40.923+0000 7fea42e99040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:41:40.989 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:40.989+0000 7fea42e99040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:41:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:41:41.276 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:41.137+0000 7fea42e99040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:41:41.276 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:41.276+0000 7fea42e99040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:41:41.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_4 2024-09-10T07:41:41.535 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:41:41.907 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:41.593+0000 7fea42e99040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:41:41.907 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:41.654+0000 7fea42e99040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:41:41.907 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:41.840+0000 7fea42e99040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:41:41.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-mon[35522]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:41.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:41.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:41.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:41.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T07:41:41.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T07:41:41.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T07:41:41.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:41.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:41 smithi073 ceph-mon[30850]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:41.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:41.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:41.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:41.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T07:41:41.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T07:41:41.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T07:41:41.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:42.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.983+0000 7fa4ed654640 1 -- 172.21.15.73:0/2375799753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 msgr2=0x7fa4e8109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:42.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.983+0000 7fa4ed654640 1 --2- 172.21.15.73:0/2375799753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 0x7fa4e8109d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009900 tx=0x7fa4d802a410 comp rx=0 tx=0).stop 2024-09-10T07:41:42.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 -- 172.21.15.73:0/2375799753 shutdown_connections 2024-09-10T07:41:42.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 --2- 172.21.15.73:0/2375799753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 0x7fa4e8109d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 --2- 172.21.15.73:0/2375799753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e8104f90 0x7fa4e8107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 --2- 172.21.15.73:0/2375799753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4e8102660 0x7fa4e8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 -- 172.21.15.73:0/2375799753 >> 172.21.15.73:0/2375799753 conn(0x7fa4e80fc280 msgr2=0x7fa4e80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 -- 172.21.15.73:0/2375799753 shutdown_connections 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 -- 172.21.15.73:0/2375799753 wait complete. 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 Processor -- start 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 -- start start 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4e8102660 0x7fa4e8101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e8104f90 0x7fa4e8100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 0x7fa4e8100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e810d900 con 0x7fa4e81078c0 2024-09-10T07:41:42.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e810d780 con 0x7fa4e8102660 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.984+0000 7fa4ed654640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e810da80 con 0x7fa4e8104f90 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 0x7fa4e8100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 0x7fa4e8100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47898/0 (socket says 172.21.15.73:47898) 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e77fe640 1 -- 172.21.15.73:0/3322604117 learned_addr learned my addr 172.21.15.73:0/3322604117 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e67fc640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e8104f90 0x7fa4e8100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e6ffd640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4e8102660 0x7fa4e8101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e77fe640 1 -- 172.21.15.73:0/3322604117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e8104f90 msgr2=0x7fa4e8100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e77fe640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e8104f90 0x7fa4e8100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e77fe640 1 -- 172.21.15.73:0/3322604117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4e8102660 msgr2=0x7fa4e8101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e77fe640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4e8102660 0x7fa4e8101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e77fe640 1 -- 172.21.15.73:0/3322604117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e8101410 con 0x7fa4e81078c0 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e6ffd640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4e8102660 0x7fa4e8101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4e77fe640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 0x7fa4e8100b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80314e0 tx=0x7fa4d8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4dffff640 1 -- 172.21.15.73:0/3322604117 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d803f030 con 0x7fa4e81078c0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4dffff640 1 -- 172.21.15.73:0/3322604117 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4d8003ce0 con 0x7fa4e81078c0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e81a2090 con 0x7fa4e81078c0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4dffff640 1 -- 172.21.15.73:0/3322604117 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8035070 con 0x7fa4e81078c0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.985+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e81a2610 con 0x7fa4e81078c0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.986+0000 7fa4dffff640 1 -- 172.21.15.73:0/3322604117 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa4d8042030 con 0x7fa4e81078c0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.986+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e80fdd70 con 0x7fa4e81078c0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.986+0000 7fa4dffff640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa4d4039290 0x7fa4d403b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.986+0000 7fa4dffff640 1 -- 172.21.15.73:0/3322604117 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa4d806ce80 con 0x7fa4e81078c0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.986+0000 7fa4e6ffd640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa4d4039290 0x7fa4d403b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.987+0000 7fa4e6ffd640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa4d4039290 0x7fa4d403b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009fa0 tx=0x7fa4e0009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:41.991+0000 7fa4dffff640 1 -- 172.21.15.73:0/3322604117 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4d803b460 con 0x7fa4e81078c0 2024-09-10T07:41:42.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:41 smithi102 ceph-mon[35514]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:42.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:42.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:42.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:42.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T07:41:42.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T07:41:42.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T07:41:42.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:42.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:42.164+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa4e8062630 con 0x7fa4d4039290 2024-09-10T07:41:42.748 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:42 smithi102 systemd[1]: Starting Ceph mgr.y for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:41:42.845 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:42 smithi073 ceph-mon[30850]: Deploying daemon mgr.y on smithi102 2024-09-10T07:41:42.845 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:42 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:41:42.845 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:42 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:41:42.845 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:42 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:43.007 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:42 smithi102 ceph-mon[35514]: Deploying daemon mgr.y on smithi102 2024-09-10T07:41:43.007 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:42 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:41:43.007 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:42 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:41:43.007 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:42 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:43.007 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:42 smithi102 podman[36869]: 2024-09-10 07:41:42.764082072 +0000 UTC m=+0.106445665 container create 42f4375eb869cc5eee649b4962a51d2626d327c21f4d0dcddfbbc8aad0857593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T07:41:43.007 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:42 smithi102 podman[36869]: 2024-09-10 07:41:42.673511806 +0000 UTC m=+0.015875411 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:41:43.007 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 podman[36869]: 2024-09-10 07:41:43.008171282 +0000 UTC m=+0.350534893 container init 42f4375eb869cc5eee649b4962a51d2626d327c21f4d0dcddfbbc8aad0857593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:41:43.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:42 smithi159 ceph-mon[35522]: Deploying daemon mgr.y on smithi102 2024-09-10T07:41:43.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:42 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:41:43.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:42 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:41:43.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:42 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:43.157 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:42.733+0000 7fea42e99040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:41:43.158 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:42.802+0000 7fea42e99040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:41:43.348 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 podman[36869]: 2024-09-10 07:41:43.010946296 +0000 UTC m=+0.353309898 container start 42f4375eb869cc5eee649b4962a51d2626d327c21f4d0dcddfbbc8aad0857593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:41:43.348 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-mgr[36889]: -- 172.21.15.102:0/1401576661 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d16d5c70e0 con 0x55d16d5a5400 2024-09-10T07:41:43.348 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 bash[36869]: 42f4375eb869cc5eee649b4962a51d2626d327c21f4d0dcddfbbc8aad0857593 2024-09-10T07:41:43.348 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 systemd[1]: Started Ceph mgr.y for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:41:43.348 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:43.132+0000 7fbcdcbcf040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:41:43.348 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:43.192+0000 7fbcdcbcf040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:41:43.348 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:43.348+0000 7fbcdcbcf040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:41:43.626 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:43.417+0000 7fbcdcbcf040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:41:43.626 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:43.583+0000 7fbcdcbcf040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:41:43.842 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-mon[35522]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:43.842 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-mon[35522]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:43.842 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:43.842 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:43.842 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:43.842 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:43.842 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:43.843 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:43.559+0000 7fea42e99040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:41:43.843 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:43.697+0000 7fea42e99040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:41:43.843 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:43.842+0000 7fea42e99040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:41:43.995 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:43.733+0000 7fbcdcbcf040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:41:43.995 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-mon[35514]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:43.995 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-mon[35514]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:43.995 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:43.996 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:43.996 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:43.996 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:43.996 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:44.106 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:43.908+0000 7fea42e99040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:41:44.106 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:44.065+0000 7fea42e99040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:41:44.132 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:43 smithi073 ceph-mon[30850]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:41:44.132 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:43 smithi073 ceph-mon[30850]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:44.133 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:44.133 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:44.133 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:44.133 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:44.133 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:44.308 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:44.057+0000 7fbcdcbcf040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:41:44.308 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:44.119+0000 7fbcdcbcf040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:41:44.369 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:44.137+0000 7fea42e99040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:41:44.369 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:44.200+0000 7fea42e99040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:41:44.370 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:44.369+0000 7fea42e99040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:41:44.626 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:44.309+0000 7fbcdcbcf040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:41:44.657 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:44.441+0000 7fea42e99040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:41:44.657 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:44.512+0000 7fea42e99040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:41:44.657 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:44.602+0000 7fea42e99040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:41:45.157 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:44.666+0000 7fea42e99040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:41:45.157 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:44.728+0000 7fea42e99040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/114570801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6e507ac-4881-43ea-95a6-3df7feba2a89"}]: dispatch 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/114570801' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6e507ac-4881-43ea-95a6-3df7feba2a89"}]': finished 2024-09-10T07:41:45.585 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T07:41:45.586 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:41:45.586 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T07:41:45.586 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T07:41:45.586 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T07:41:45.586 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:45.586 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: Reconfiguring daemon mgr.x on smithi073 2024-09-10T07:41:45.586 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:45.586 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.586 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:45 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4248485087' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:41:45.626 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:45.196+0000 7fbcdcbcf040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:41:45.626 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:45.263+0000 7fbcdcbcf040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:41:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/114570801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6e507ac-4881-43ea-95a6-3df7feba2a89"}]: dispatch 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/114570801' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6e507ac-4881-43ea-95a6-3df7feba2a89"}]': finished 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T07:41:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T07:41:45.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T07:41:45.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:45.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: Reconfiguring daemon mgr.x on smithi073 2024-09-10T07:41:45.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:45.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/4248485087' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:41:45.657 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:41:45.555+0000 7fea42e99040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:41:45.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/114570801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6e507ac-4881-43ea-95a6-3df7feba2a89"}]: dispatch 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/114570801' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6e507ac-4881-43ea-95a6-3df7feba2a89"}]': finished 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T07:41:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T07:41:45.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T07:41:45.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:45.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: Reconfiguring daemon mgr.x on smithi073 2024-09-10T07:41:45.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:45.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:45.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:45 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/4248485087' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:41:46.232 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:45.978+0000 7fbcdcbcf040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:41:46.233 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.093+0000 7fbcdcbcf040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:41:46.233 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.233+0000 7fbcdcbcf040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:41:46.506 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.293+0000 7fbcdcbcf040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:41:46.506 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.440+0000 7fbcdcbcf040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:41:46.506 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.506+0000 7fbcdcbcf040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:41:46.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:46.547+0000 7fa4dffff640 1 -- 172.21.15.73:0/3322604117 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7fa4d8071070 con 0x7fa4e81078c0 2024-09-10T07:41:46.788 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.567+0000 7fbcdcbcf040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:41:46.788 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.724+0000 7fbcdcbcf040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:41:46.789 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.788+0000 7fbcdcbcf040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:41:46.789 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-mon[35514]: Standby manager daemon z started 2024-09-10T07:41:46.789 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T07:41:46.789 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:41:46.789 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T07:41:46.789 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:41:46.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:46 smithi159 ceph-mon[35522]: Standby manager daemon z started 2024-09-10T07:41:46.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:46 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T07:41:46.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:46 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:41:46.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:46 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T07:41:46.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:46 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:41:46.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:46 smithi073 ceph-mon[30850]: Standby manager daemon z started 2024-09-10T07:41:46.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:46 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T07:41:46.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:46 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:41:46.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:46 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T07:41:46.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:46 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.159:0/3344450110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:41:47.054 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.854+0000 7fbcdcbcf040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:41:47.054 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.936+0000 7fbcdcbcf040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:41:47.055 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:46.996+0000 7fbcdcbcf040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:41:47.055 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:47.054+0000 7fbcdcbcf040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:41:47.832 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:47 smithi102 ceph-mon[35514]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-10T07:41:47.832 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T07:41:47.832 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:47 smithi102 ceph-mon[35514]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:47.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:47 smithi159 ceph-mon[35522]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-10T07:41:47.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T07:41:47.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:47 smithi159 ceph-mon[35522]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:47.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:47 smithi073 ceph-mon[30850]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-10T07:41:47.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T07:41:47.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:47 smithi073 ceph-mon[30850]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:48.126 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:41:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:41:47.832+0000 7fbcdcbcf040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:41:48.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:41:48.560+0000 7fa4dffff640 1 -- 172.21.15.73:0/3322604117 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fa4d803aca0 con 0x7fa4e81078c0 2024-09-10T07:41:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:48 smithi102 ceph-mon[35514]: Standby manager daemon y started 2024-09-10T07:41:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:48 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T07:41:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:48 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:41:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:48 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T07:41:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:48 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:41:48.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:48 smithi159 ceph-mon[35522]: Standby manager daemon y started 2024-09-10T07:41:48.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:48 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T07:41:48.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:48 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:41:48.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:48 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T07:41:48.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:48 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:41:48.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:48 smithi073 ceph-mon[30850]: Standby manager daemon y started 2024-09-10T07:41:48.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:48 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T07:41:48.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:48 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:41:48.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:48 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T07:41:48.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:48 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.102:0/390550037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:41:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:49 smithi102 ceph-mon[35514]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-10T07:41:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T07:41:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:49 smithi102 ceph-mon[35514]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:49 smithi159 ceph-mon[35522]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-10T07:41:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T07:41:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:49 smithi159 ceph-mon[35522]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:49.956 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:49 smithi073 ceph-mon[30850]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-10T07:41:49.956 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T07:41:49.956 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:49 smithi073 ceph-mon[30850]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:51.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:51 smithi073 ceph-mon[30850]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:51.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:51.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:51.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:51.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:51 smithi159 ceph-mon[35522]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:51.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:51.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:51.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:51 smithi102 ceph-mon[35514]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:41:52.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:52.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:52.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:52.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:52.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:52.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:53.027 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:53.027 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:41:53.027 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:41:53.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:53 smithi073 ceph-mon[30850]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:53.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:53 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T07:41:53.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:53 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:53 smithi102 ceph-mon[35514]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:53 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T07:41:54.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:53 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:53 smithi159 ceph-mon[35522]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:53 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T07:41:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:53 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:41:54.965 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:54 smithi073 ceph-mon[30850]: Deploying daemon osd.0 on smithi073 2024-09-10T07:41:55.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:54 smithi102 ceph-mon[35514]: Deploying daemon osd.0 on smithi073 2024-09-10T07:41:55.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:54 smithi159 ceph-mon[35522]: Deploying daemon osd.0 on smithi073 2024-09-10T07:41:55.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:55 smithi073 ceph-mon[30850]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:55 smithi102 ceph-mon[35514]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:56.160 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:55 smithi159 ceph-mon[35522]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:57.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:57 smithi073 ceph-mon[30850]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:57 smithi102 ceph-mon[35514]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:57 smithi159 ceph-mon[35522]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:41:59.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:41:59 smithi073 ceph-mon[30850]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:00.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:41:59 smithi102 ceph-mon[35514]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:41:59 smithi159 ceph-mon[35522]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:00.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:00 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:00.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:00 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:00.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:00 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:01.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:00 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:01.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:00 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:01.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:00 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:01.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:00 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:01.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:00 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:01.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:00 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:01.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:01 smithi073 ceph-mon[30850]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:01 smithi102 ceph-mon[35514]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:01 smithi159 ceph-mon[35522]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:03.375 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:03.375 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:03.375 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:03.375 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:03.375 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:03.375 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:02 smithi073 ceph-mon[30850]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:03.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:03.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:03.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:03.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:03.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:03.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:02 smithi102 ceph-mon[35514]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:03.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:03.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:03.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:03.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:03.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:03.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:02 smithi159 ceph-mon[35522]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:03.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.886+0000 7fa4dffff640 1 -- 172.21.15.73:0/3322604117 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa4e8062630 con 0x7fa4d4039290 2024-09-10T07:42:03.887 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 0 on host 'smithi073' 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa4d4039290 msgr2=0x7fa4d403b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa4d4039290 0x7fa4d403b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009fa0 tx=0x7fa4e0009570 comp rx=0 tx=0).stop 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 msgr2=0x7fa4e8100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 0x7fa4e8100b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80314e0 tx=0x7fa4d8004360 comp rx=0 tx=0).stop 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 shutdown_connections 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa4d4039290 0x7fa4d403b750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4e81078c0 0x7fa4e8100b50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e8104f90 0x7fa4e8100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 --2- 172.21.15.73:0/3322604117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4e8102660 0x7fa4e8101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 >> 172.21.15.73:0/3322604117 conn(0x7fa4e80fc280 msgr2=0x7fa4e8102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 shutdown_connections 2024-09-10T07:42:03.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:03.889+0000 7fa4ed654640 1 -- 172.21.15.73:0/3322604117 wait complete. 2024-09-10T07:42:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:04 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:04 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:04 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:04.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:04 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:04.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:04 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:04.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:04 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:04.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:04 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:04.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:04 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:04.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:04 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:04.504 DEBUG:teuthology.orchestra.run.smithi073:osd.0> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T07:42:04.507 INFO:tasks.cephadm:Deploying osd.1 on smithi102 with /dev/vg_nvme/lv_4... 2024-09-10T07:42:04.507 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T07:42:04.746 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:42:05.030 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:05 smithi073 ceph-mon[30850]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:05.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:05 smithi102 ceph-mon[35514]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:05.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:05 smithi159 ceph-mon[35522]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:06.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:06 smithi102 ceph-mon[35514]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T07:42:06.650 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:06 smithi073 ceph-mon[30850]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T07:42:06.650 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:42:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0[44970]: 2024-09-10T07:42:06.248+0000 7f959f33d640 -1 osd.0 0 log_to_monitors true 2024-09-10T07:42:06.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:06 smithi159 ceph-mon[35522]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T07:42:07.168 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:42:07.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_4 2024-09-10T07:42:07.443 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:42:07.473 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T07:42:07.473 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T07:42:07.473 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:42:07.473 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:07.473 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:07.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:07.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T07:42:07.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T07:42:07.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:42:07.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:07.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:07.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:07.722 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0[44970]: 2024-09-10T07:42:07.310+0000 7f959aa9d640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T07:42:07.723 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0[44970]: 2024-09-10T07:42:07.316+0000 7f95970d7640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:42:07.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T07:42:07.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T07:42:07.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:42:07.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:07.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:07.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:42:07.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:07.725 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:07.725 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:07.725 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:42:07.725 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T07:42:07.725 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:07.725 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.912+0000 7f8fa27b0640 1 -- 172.21.15.102:0/1427343822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c101cd0 msgr2=0x7f8f9c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.912+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/1427343822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c101cd0 0x7f8f9c102150 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009900 tx=0x7f8f9002a410 comp rx=0 tx=0).stop 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.912+0000 7f8fa27b0640 1 -- 172.21.15.102:0/1427343822 shutdown_connections 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.912+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/1427343822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c102690 0x7f8f9c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.912+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/1427343822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c101cd0 0x7f8f9c102150 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.912+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/1427343822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c100ad0 0x7f8f9c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.912+0000 7f8fa27b0640 1 -- 172.21.15.102:0/1427343822 >> 172.21.15.102:0/1427343822 conn(0x7f8f9c0fc280 msgr2=0x7f8f9c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.912+0000 7f8fa27b0640 1 -- 172.21.15.102:0/1427343822 shutdown_connections 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.912+0000 7f8fa27b0640 1 -- 172.21.15.102:0/1427343822 wait complete. 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8fa27b0640 1 Processor -- start 2024-09-10T07:42:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8fa27b0640 1 -- start start 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8fa27b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c100ad0 0x7f8f9c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8fa27b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c101cd0 0x7f8f9c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8fa27b0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c102690 0x7f8f9c19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8fa27b0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c10c7b0 con 0x7f8f9c102690 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8fa27b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c10c630 con 0x7f8f9c100ad0 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8fa27b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c10c930 con 0x7f8f9c101cd0 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c100ad0 0x7f8f9c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c100ad0 0x7f8f9c197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34018/0 (socket says 172.21.15.102:34018) 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8f9bfff640 1 -- 172.21.15.102:0/2198652587 learned_addr learned my addr 172.21.15.102:0/2198652587 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8fa0d4d640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c102690 0x7f8f9c19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8f9b7fe640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c101cd0 0x7f8f9c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:07.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8f9bfff640 1 -- 172.21.15.102:0/2198652587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c101cd0 msgr2=0x7f8f9c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8f9bfff640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c101cd0 0x7f8f9c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8f9bfff640 1 -- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c102690 msgr2=0x7f8f9c19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.913+0000 7f8f9bfff640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c102690 0x7f8f9c19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.914+0000 7f8f9bfff640 1 -- 172.21.15.102:0/2198652587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c19fbb0 con 0x7f8f9c100ad0 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.914+0000 7f8f9bfff640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c100ad0 0x7f8f9c197f80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00d770 tx=0x7f8f8c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.914+0000 7f8f997fa640 1 -- 172.21.15.102:0/2198652587 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c017070 con 0x7f8f9c100ad0 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.914+0000 7f8f997fa640 1 -- 172.21.15.102:0/2198652587 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f8c009c30 con 0x7f8f9c100ad0 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.914+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9c19fea0 con 0x7f8f9c100ad0 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.914+0000 7f8f997fa640 1 -- 172.21.15.102:0/2198652587 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c003dd0 con 0x7f8f9c100ad0 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.914+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9c1a0380 con 0x7f8f9c100ad0 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.915+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9c1a05b0 con 0x7f8f9c100ad0 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.916+0000 7f8f997fa640 1 -- 172.21.15.102:0/2198652587 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f8f8c003f70 con 0x7f8f9c100ad0 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.917+0000 7f8f997fa640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8f840a2ba0 0x7f8f840a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.917+0000 7f8f997fa640 1 -- 172.21.15.102:0/2198652587 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f8f8c0cd120 con 0x7f8f9c100ad0 2024-09-10T07:42:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.917+0000 7f8f9b7fe640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8f840a2ba0 0x7f8f840a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.917+0000 7f8f9b7fe640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8f840a2ba0 0x7f8f840a5060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f90000c00 tx=0x7f8f900315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:42:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:07.920+0000 7f8f997fa640 1 -- 172.21.15.102:0/2198652587 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f8c009de0 con 0x7f8f9c100ad0 2024-09-10T07:42:08.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:08.098+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8f9c1a0840 con 0x7f8f840a2ba0 2024-09-10T07:42:08.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:08 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi073 2024-09-10T07:42:08.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:08 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi073 to 17088M 2024-09-10T07:42:08.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:08 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:42:08.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:08 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:42:08.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:08 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:08.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:08 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:08.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:08 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi073 2024-09-10T07:42:08.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:08 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi073 to 17088M 2024-09-10T07:42:08.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:08 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:42:08.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:08 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:42:08.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:08 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:08.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:08 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:08.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:08 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi073 2024-09-10T07:42:08.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:08 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi073 to 17088M 2024-09-10T07:42:08.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:08 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:42:08.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:08 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:42:08.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:08 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:08.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:08 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:09.440 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:09 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:42:09.441 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:09 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:42:09.441 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:09 smithi102 ceph-mon[35514]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:42:09.441 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:09 smithi102 ceph-mon[35514]: osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] boot 2024-09-10T07:42:09.441 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:09 smithi102 ceph-mon[35514]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T07:42:09.441 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:09.441 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:09 smithi102 ceph-mon[35514]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:09.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:09 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:42:09.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:09 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:42:09.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:09 smithi159 ceph-mon[35522]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:42:09.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:09 smithi159 ceph-mon[35522]: osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] boot 2024-09-10T07:42:09.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:09 smithi159 ceph-mon[35522]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T07:42:09.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:09.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:09 smithi159 ceph-mon[35522]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:09.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:09 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:42:09.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:09 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:42:09.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:09 smithi073 ceph-mon[30850]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:42:09.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:09 smithi073 ceph-mon[30850]: osd.0 [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] boot 2024-09-10T07:42:09.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:09 smithi073 ceph-mon[30850]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T07:42:09.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:42:09.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:09 smithi073 ceph-mon[30850]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T07:42:10.611 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:10 smithi102 ceph-mon[35514]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T07:42:10.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:10 smithi159 ceph-mon[35522]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T07:42:10.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:10 smithi073 ceph-mon[30850]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T07:42:11.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:11 smithi102 ceph-mon[35514]: from='client.? 172.21.15.102:0/584519732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e703b50-3e28-499d-a8c4-4068826a16fb"}]: dispatch 2024-09-10T07:42:11.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:11 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e703b50-3e28-499d-a8c4-4068826a16fb"}]: dispatch 2024-09-10T07:42:11.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:11 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e703b50-3e28-499d-a8c4-4068826a16fb"}]': finished 2024-09-10T07:42:11.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:11 smithi102 ceph-mon[35514]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T07:42:11.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:11.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:11 smithi102 ceph-mon[35514]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:11.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:11 smithi102 ceph-mon[35514]: from='client.? 172.21.15.102:0/358455510' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:42:11.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:11 smithi159 ceph-mon[35522]: from='client.? 172.21.15.102:0/584519732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e703b50-3e28-499d-a8c4-4068826a16fb"}]: dispatch 2024-09-10T07:42:11.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:11 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e703b50-3e28-499d-a8c4-4068826a16fb"}]: dispatch 2024-09-10T07:42:11.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:11 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e703b50-3e28-499d-a8c4-4068826a16fb"}]': finished 2024-09-10T07:42:11.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:11 smithi159 ceph-mon[35522]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T07:42:11.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:11.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:11 smithi159 ceph-mon[35522]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:11.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:11 smithi159 ceph-mon[35522]: from='client.? 172.21.15.102:0/358455510' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:42:11.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:11 smithi073 ceph-mon[30850]: from='client.? 172.21.15.102:0/584519732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e703b50-3e28-499d-a8c4-4068826a16fb"}]: dispatch 2024-09-10T07:42:11.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:11 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e703b50-3e28-499d-a8c4-4068826a16fb"}]: dispatch 2024-09-10T07:42:11.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:11 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e703b50-3e28-499d-a8c4-4068826a16fb"}]': finished 2024-09-10T07:42:11.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:11 smithi073 ceph-mon[30850]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T07:42:11.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:11.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:11 smithi073 ceph-mon[30850]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:11.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:11 smithi073 ceph-mon[30850]: from='client.? 172.21.15.102:0/358455510' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:42:13.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:13 smithi159 ceph-mon[35522]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:13 smithi073 ceph-mon[30850]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:13 smithi102 ceph-mon[35514]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:15.754 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:15 smithi102 ceph-mon[35514]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:15.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:15 smithi159 ceph-mon[35522]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:15.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:15 smithi073 ceph-mon[30850]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:17.774 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:17 smithi102 ceph-mon[35514]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:17 smithi073 ceph-mon[30850]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:17 smithi159 ceph-mon[35522]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:19 smithi073 ceph-mon[30850]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:19 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T07:42:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:19 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:19 smithi102 ceph-mon[35514]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:19 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T07:42:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:19 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:20.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:19 smithi159 ceph-mon[35522]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:20.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:19 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T07:42:20.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:19 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:20.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:20 smithi102 ceph-mon[35514]: Deploying daemon osd.1 on smithi102 2024-09-10T07:42:20.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:20 smithi073 ceph-mon[30850]: Deploying daemon osd.1 on smithi102 2024-09-10T07:42:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:20 smithi159 ceph-mon[35522]: Deploying daemon osd.1 on smithi102 2024-09-10T07:42:21.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:21 smithi073 ceph-mon[30850]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:21.977 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:21 smithi102 ceph-mon[35514]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:21 smithi159 ceph-mon[35522]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:23.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:23 smithi073 ceph-mon[30850]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:24.093 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:23 smithi102 ceph-mon[35514]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:23 smithi159 ceph-mon[35522]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:25.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:25 smithi073 ceph-mon[30850]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:25.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:25.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:25.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:26.021 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:25 smithi102 ceph-mon[35514]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:26.022 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:26.022 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:26.022 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:25 smithi159 ceph-mon[35522]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:27.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:27 smithi073 ceph-mon[30850]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:27 smithi102 ceph-mon[35514]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:27 smithi159 ceph-mon[35522]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:28.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.826+0000 7f8f997fa640 1 -- 172.21.15.102:0/2198652587 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8f9c1a0840 con 0x7f8f840a2ba0 2024-09-10T07:42:28.826 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 1 on host 'smithi102' 2024-09-10T07:42:28.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8f840a2ba0 msgr2=0x7f8f840a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:28.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8f840a2ba0 0x7f8f840a5060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f90000c00 tx=0x7f8f900315d0 comp rx=0 tx=0).stop 2024-09-10T07:42:28.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c100ad0 msgr2=0x7f8f9c197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:28.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c100ad0 0x7f8f9c197f80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00d770 tx=0x7f8f8c00dc30 comp rx=0 tx=0).stop 2024-09-10T07:42:28.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 shutdown_connections 2024-09-10T07:42:28.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8f840a2ba0 0x7f8f840a5060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:28.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c102690 0x7f8f9c19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:28.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c101cd0 0x7f8f9c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:28.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 --2- 172.21.15.102:0/2198652587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f9c100ad0 0x7f8f9c197f80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:28.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 >> 172.21.15.102:0/2198652587 conn(0x7f8f9c0fc280 msgr2=0x7f8f9c06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:42:28.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 shutdown_connections 2024-09-10T07:42:28.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:42:28.829+0000 7f8fa27b0640 1 -- 172.21.15.102:0/2198652587 wait complete. 2024-09-10T07:42:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:28 smithi102 ceph-mon[35514]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:29.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:29.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:29.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:29.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:28 smithi073 ceph-mon[30850]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:29.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:29.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:29.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:29.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:28 smithi159 ceph-mon[35522]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:29.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:29.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:29.505 DEBUG:teuthology.orchestra.run.smithi102:osd.1> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T07:42:29.508 INFO:tasks.cephadm:Deploying osd.2 on smithi159 with /dev/vg_nvme/lv_4... 2024-09-10T07:42:29.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T07:42:29.760 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:42:31.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:31 smithi102 ceph-mon[35514]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:31.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:31 smithi102 ceph-mon[35514]: from='osd.1 [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T07:42:31.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:31 smithi102 ceph-mon[35514]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T07:42:31.834 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:42:31 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1[40020]: 2024-09-10T07:42:31.529+0000 7fb949ab8640 -1 osd.1 0 log_to_monitors true 2024-09-10T07:42:31.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:31 smithi159 ceph-mon[35522]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:31.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:31 smithi159 ceph-mon[35522]: from='osd.1 [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T07:42:31.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:31 smithi159 ceph-mon[35522]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T07:42:31.919 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:42:31.945 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_4 2024-09-10T07:42:31.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:31 smithi073 ceph-mon[30850]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:31.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:31 smithi073 ceph-mon[30850]: from='osd.1 [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T07:42:31.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:31 smithi073 ceph-mon[30850]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T07:42:32.189 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:42:32.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.615+0000 7ff8694ad640 1 -- 172.21.15.159:0/331563578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864102690 msgr2=0x7ff864108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:32.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.615+0000 7ff8694ad640 1 --2- 172.21.15.159:0/331563578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864102690 0x7ff864108f20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009ca0 tx=0x7ff85c02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:42:32.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.615+0000 7ff8694ad640 1 -- 172.21.15.159:0/331563578 shutdown_connections 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.615+0000 7ff8694ad640 1 --2- 172.21.15.159:0/331563578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864102690 0x7ff864108f20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.615+0000 7ff8694ad640 1 --2- 172.21.15.159:0/331563578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff864101cd0 0x7ff864102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.615+0000 7ff8694ad640 1 --2- 172.21.15.159:0/331563578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff864100ad0 0x7ff864100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.615+0000 7ff8694ad640 1 -- 172.21.15.159:0/331563578 >> 172.21.15.159:0/331563578 conn(0x7ff8640fc280 msgr2=0x7ff8640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.615+0000 7ff8694ad640 1 -- 172.21.15.159:0/331563578 shutdown_connections 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.615+0000 7ff8694ad640 1 -- 172.21.15.159:0/331563578 wait complete. 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8694ad640 1 Processor -- start 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8694ad640 1 -- start start 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8694ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864100ad0 0x7ff86406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8694ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff864101cd0 0x7ff86419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8694ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff864102690 0x7ff86419f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8694ad640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff86410c730 con 0x7ff864102690 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8694ad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff86410c5b0 con 0x7ff864101cd0 2024-09-10T07:42:32.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8694ad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff86410c8b0 con 0x7ff864100ad0 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff862ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864100ad0 0x7ff86406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff862ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864100ad0 0x7ff86406aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34216/0 (socket says 172.21.15.159:34216) 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff862ffd640 1 -- 172.21.15.159:0/2920489381 learned_addr learned my addr 172.21.15.159:0/2920489381 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8627fc640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff864101cd0 0x7ff86419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.616+0000 7ff8637fe640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff864102690 0x7ff86419f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff862ffd640 1 -- 172.21.15.159:0/2920489381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff864101cd0 msgr2=0x7ff86419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff862ffd640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff864101cd0 0x7ff86419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff862ffd640 1 -- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff864102690 msgr2=0x7ff86419f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff862ffd640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff864102690 0x7ff86419f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff862ffd640 1 -- 172.21.15.159:0/2920489381 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86419fb10 con 0x7ff864100ad0 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff8627fc640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff864101cd0 0x7ff86419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff862ffd640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864100ad0 0x7ff86406aad0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff85400d770 tx=0x7ff85400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:42:32.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff84bfff640 1 -- 172.21.15.159:0/2920489381 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854017070 con 0x7ff864100ad0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff84bfff640 1 -- 172.21.15.159:0/2920489381 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff854009c30 con 0x7ff864100ad0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86419fda0 con 0x7ff864100ad0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff84bfff640 1 -- 172.21.15.159:0/2920489381 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854003dd0 con 0x7ff864100ad0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.617+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8641a0250 con 0x7ff864100ad0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.618+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff864107e70 con 0x7ff864100ad0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.619+0000 7ff84bfff640 1 -- 172.21.15.159:0/2920489381 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7ff854003f70 con 0x7ff864100ad0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.620+0000 7ff84bfff640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff84c0a2af0 0x7ff84c0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.620+0000 7ff84bfff640 1 -- 172.21.15.159:0/2920489381 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7ff8540cd2e0 con 0x7ff864100ad0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.620+0000 7ff8627fc640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff84c0a2af0 0x7ff84c0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.621+0000 7ff8627fc640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff84c0a2af0 0x7ff84c0a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff86406b050 tx=0x7ff858005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:42:32.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.623+0000 7ff84bfff640 1 -- 172.21.15.159:0/2920489381 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff854009de0 con 0x7ff864100ad0 2024-09-10T07:42:32.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:32.807+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff864062630 con 0x7ff84c0a2af0 2024-09-10T07:42:32.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T07:42:32.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='osd.1 [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:42:32.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T07:42:32.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:32.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:42:32.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:32.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:32.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:42:32.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:32.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:32.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:32.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:32.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T07:42:32.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='osd.1 [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:32.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:33.126 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1[40020]: 2024-09-10T07:42:32.671+0000 7fb945218640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T07:42:33.126 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1[40020]: 2024-09-10T07:42:32.674+0000 7fb941852640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:42:33.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='osd.1 [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:33.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:33.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi102 2024-09-10T07:42:33.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-10T07:42:33.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:33.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:42:33.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T07:42:33.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:33.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:33.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:42:33.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:42:33.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:33.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi102 2024-09-10T07:42:33.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-10T07:42:33.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:33.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:42:33.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T07:42:33.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:33.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:33.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:42:33.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:42:33.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi102 2024-09-10T07:42:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-10T07:42:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:42:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T07:42:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:34.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:34.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:42:34.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:42:34.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:34.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:34 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:42:34.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:34 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:42:34.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:34 smithi073 ceph-mon[30850]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:42:34.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:34 smithi073 ceph-mon[30850]: osd.1 [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] boot 2024-09-10T07:42:34.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:34 smithi073 ceph-mon[30850]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T07:42:34.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:35.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:34 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:42:35.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:34 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:42:35.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:34 smithi102 ceph-mon[35514]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:42:35.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:34 smithi102 ceph-mon[35514]: osd.1 [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] boot 2024-09-10T07:42:35.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:34 smithi102 ceph-mon[35514]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T07:42:35.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:34 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:42:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:34 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:42:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:34 smithi159 ceph-mon[35522]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:42:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:34 smithi159 ceph-mon[35522]: osd.1 [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] boot 2024-09-10T07:42:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:34 smithi159 ceph-mon[35522]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T07:42:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:42:35.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:35 smithi102 ceph-mon[35514]: pgmap v58: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:35.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:35 smithi102 ceph-mon[35514]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T07:42:35.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:35 smithi102 ceph-mon[35514]: from='client.? 172.21.15.159:0/2147822117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fdc851-2a35-4284-8351-1e213d072217"}]: dispatch 2024-09-10T07:42:35.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:35 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fdc851-2a35-4284-8351-1e213d072217"}]: dispatch 2024-09-10T07:42:35.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:35 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12fdc851-2a35-4284-8351-1e213d072217"}]': finished 2024-09-10T07:42:35.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:35 smithi102 ceph-mon[35514]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T07:42:35.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:35 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:35.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:35 smithi102 ceph-mon[35514]: from='client.? 172.21.15.159:0/2332645439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:42:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:35 smithi159 ceph-mon[35522]: pgmap v58: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:35 smithi159 ceph-mon[35522]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T07:42:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:35 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/2147822117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fdc851-2a35-4284-8351-1e213d072217"}]: dispatch 2024-09-10T07:42:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:35 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fdc851-2a35-4284-8351-1e213d072217"}]: dispatch 2024-09-10T07:42:35.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:35 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12fdc851-2a35-4284-8351-1e213d072217"}]': finished 2024-09-10T07:42:35.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:35 smithi159 ceph-mon[35522]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T07:42:35.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:35 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:35.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:35 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/2332645439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:42:35.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:35 smithi073 ceph-mon[30850]: pgmap v58: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-10T07:42:35.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:35 smithi073 ceph-mon[30850]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T07:42:35.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:35 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/2147822117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fdc851-2a35-4284-8351-1e213d072217"}]: dispatch 2024-09-10T07:42:35.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:35 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fdc851-2a35-4284-8351-1e213d072217"}]: dispatch 2024-09-10T07:42:35.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:35 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12fdc851-2a35-4284-8351-1e213d072217"}]': finished 2024-09-10T07:42:35.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:35 smithi073 ceph-mon[30850]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T07:42:35.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:35 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:35.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:35 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/2332645439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:42:37.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:37 smithi073 ceph-mon[30850]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:37 smithi102 ceph-mon[35514]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:38.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:37 smithi159 ceph-mon[35522]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:39.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:39 smithi073 ceph-mon[30850]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:40.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:39 smithi102 ceph-mon[35514]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:40.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:39 smithi159 ceph-mon[35522]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:41.791 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:41 smithi159 ceph-mon[35522]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:41.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:41 smithi073 ceph-mon[30850]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:42.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:41 smithi102 ceph-mon[35514]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:43.876 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:43 smithi159 ceph-mon[35522]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:43.876 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T07:42:43.876 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:43.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:43 smithi073 ceph-mon[30850]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:43.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T07:42:43.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:43 smithi102 ceph-mon[35514]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T07:42:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:44.705 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:44 smithi159 ceph-mon[35522]: Deploying daemon osd.2 on smithi159 2024-09-10T07:42:44.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:44 smithi073 ceph-mon[30850]: Deploying daemon osd.2 on smithi159 2024-09-10T07:42:45.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:44 smithi102 ceph-mon[35514]: Deploying daemon osd.2 on smithi159 2024-09-10T07:42:45.786 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:45 smithi159 ceph-mon[35522]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:45.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:45 smithi073 ceph-mon[30850]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:46.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:45 smithi102 ceph-mon[35514]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:47.885 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:47 smithi159 ceph-mon[35522]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:47.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:47 smithi073 ceph-mon[30850]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:47 smithi102 ceph-mon[35514]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:49.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:49 smithi073 ceph-mon[30850]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:49.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:49.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:49.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:50.019 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:49 smithi159 ceph-mon[35522]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:50.019 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:50.020 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:50.020 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:50.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:49 smithi102 ceph-mon[35514]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:50.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:50.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:50.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:51.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:51 smithi073 ceph-mon[30850]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:51 smithi102 ceph-mon[35514]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:51 smithi159 ceph-mon[35522]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:52.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:52.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:52.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:52.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:52.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:52.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:52 smithi159 ceph-mon[35522]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:53.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:53.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:53.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:53.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:53.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:53.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:52 smithi102 ceph-mon[35514]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:52 smithi073 ceph-mon[30850]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:53.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.372+0000 7ff84bfff640 1 -- 172.21.15.159:0/2920489381 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff864062630 con 0x7ff84c0a2af0 2024-09-10T07:42:53.373 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 2 on host 'smithi159' 2024-09-10T07:42:53.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff84c0a2af0 msgr2=0x7ff84c0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff84c0a2af0 0x7ff84c0a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff86406b050 tx=0x7ff858005f90 comp rx=0 tx=0).stop 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864100ad0 msgr2=0x7ff86406aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864100ad0 0x7ff86406aad0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff85400d770 tx=0x7ff85400dc30 comp rx=0 tx=0).stop 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 shutdown_connections 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff84c0a2af0 0x7ff84c0a4fb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff864102690 0x7ff86419f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff864101cd0 0x7ff86419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 --2- 172.21.15.159:0/2920489381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff864100ad0 0x7ff86406aad0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 >> 172.21.15.159:0/2920489381 conn(0x7ff8640fc280 msgr2=0x7ff864105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 shutdown_connections 2024-09-10T07:42:53.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:42:53.375+0000 7ff8694ad640 1 -- 172.21.15.159:0/2920489381 wait complete. 2024-09-10T07:42:53.917 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:53 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:53.917 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:53 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:53.917 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:53 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:53.919 DEBUG:teuthology.orchestra.run.smithi159:osd.2> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T07:42:53.921 INFO:tasks.cephadm:Deploying osd.3 on smithi073 with /dev/vg_nvme/lv_3... 2024-09-10T07:42:53.922 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T07:42:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:53 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:53 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:53 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:42:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:53 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:42:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:53 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:53 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:54.883 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:54 smithi159 ceph-mon[35522]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:54.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:54 smithi073 ceph-mon[30850]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:55.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:54 smithi102 ceph-mon[35514]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:55.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:55 smithi159 ceph-mon[35522]: from='osd.2 [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T07:42:55.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:55 smithi159 ceph-mon[35522]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T07:42:55.908 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:42:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2[40503]: 2024-09-10T07:42:55.632+0000 7f33a4525640 -1 osd.2 0 log_to_monitors true 2024-09-10T07:42:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:55 smithi102 ceph-mon[35514]: from='osd.2 [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T07:42:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:55 smithi102 ceph-mon[35514]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T07:42:56.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:55 smithi073 ceph-mon[30850]: from='osd.2 [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T07:42:56.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:55 smithi073 ceph-mon[30850]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T07:42:56.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:42:56.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_3 2024-09-10T07:42:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='osd.2 [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi159 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-10T07:42:56.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:56.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:56.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:56.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:56.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:56 smithi073 ceph-mon[30850]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:57.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T07:42:57.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T07:42:57.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='osd.2 [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:42:57.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:57.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:42:57.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi159 2024-09-10T07:42:57.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:57.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:57.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:42:57.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-10T07:42:57.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:57.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:57.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:57.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:57.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:56 smithi102 ceph-mon[35514]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:57.157 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2[40503]: 2024-09-10T07:42:56.827+0000 7f339fc85640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T07:42:57.157 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2[40503]: 2024-09-10T07:42:56.832+0000 7f339c2bf640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:42:57.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='osd.2 [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi159 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:57.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:57.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:42:57.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:42:57.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:56 smithi159 ceph-mon[35522]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:57.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.342+0000 7f2584ebf640 1 -- 172.21.15.73:0/2545958462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580101cd0 msgr2=0x7f2580102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:57.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.342+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2545958462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580101cd0 0x7f2580102150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2574009900 tx=0x7f257402a410 comp rx=0 tx=0).stop 2024-09-10T07:42:57.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.342+0000 7f2584ebf640 1 -- 172.21.15.73:0/2545958462 shutdown_connections 2024-09-10T07:42:57.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.342+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2545958462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580102690 0x7f2580108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:57.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.342+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2545958462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580101cd0 0x7f2580102150 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:57.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.342+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2545958462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580100ad0 0x7f2580100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:57.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.342+0000 7f2584ebf640 1 -- 172.21.15.73:0/2545958462 >> 172.21.15.73:0/2545958462 conn(0x7f25800fc280 msgr2=0x7f25800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:42:57.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.342+0000 7f2584ebf640 1 -- 172.21.15.73:0/2545958462 shutdown_connections 2024-09-10T07:42:57.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.342+0000 7f2584ebf640 1 -- 172.21.15.73:0/2545958462 wait complete. 2024-09-10T07:42:57.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f2584ebf640 1 Processor -- start 2024-09-10T07:42:57.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f2584ebf640 1 -- start start 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f2584ebf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580100ad0 0x7f2580197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f2584ebf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580101cd0 0x7f2580198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f2584ebf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580102690 0x7f258019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f2584ebf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f258010c7d0 con 0x7f2580102690 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f2584ebf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f258010c650 con 0x7f2580101cd0 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f2584ebf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f258010c950 con 0x7f2580100ad0 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f257ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580102690 0x7f258019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f257e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580100ad0 0x7f2580197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f257ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580102690 0x7f258019f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44462/0 (socket says 172.21.15.73:44462) 2024-09-10T07:42:57.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f257e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580100ad0 0x7f2580197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.73:35198/0 (socket says 172.21.15.73:35198) 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.343+0000 7f257ed9d640 1 -- 172.21.15.73:0/2631360209 learned_addr learned my addr 172.21.15.73:0/2631360209 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f257dd9b640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580101cd0 0x7f2580198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f257ed9d640 1 -- 172.21.15.73:0/2631360209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580100ad0 msgr2=0x7f2580197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f257ed9d640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580100ad0 0x7f2580197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f257ed9d640 1 -- 172.21.15.73:0/2631360209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580101cd0 msgr2=0x7f2580198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f257ed9d640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580101cd0 0x7f2580198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f257ed9d640 1 -- 172.21.15.73:0/2631360209 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258019fba0 con 0x7f2580102690 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f257e59c640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580100ad0 0x7f2580197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f257ed9d640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580102690 0x7f258019f530 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f257800b970 tx=0x7f257800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:42:57.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f256f7fe640 1 -- 172.21.15.73:0/2631360209 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578019070 con 0x7f2580102690 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f256f7fe640 1 -- 172.21.15.73:0/2631360209 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f257800cb40 con 0x7f2580102690 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258019fe90 con 0x7f2580102690 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f256f7fe640 1 -- 172.21.15.73:0/2631360209 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578007650 con 0x7f2580102690 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.344+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25801a03c0 con 0x7f2580102690 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.345+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25801a0650 con 0x7f2580102690 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.346+0000 7f256f7fe640 1 -- 172.21.15.73:0/2631360209 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f257801c070 con 0x7f2580102690 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.347+0000 7f256f7fe640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25680a2ba0 0x7f25680a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.347+0000 7f257e59c640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25680a2ba0 0x7f25680a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.347+0000 7f256f7fe640 1 -- 172.21.15.73:0/2631360209 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f25780ccdc0 con 0x7f2580102690 2024-09-10T07:42:57.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.347+0000 7f257e59c640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25680a2ba0 0x7f25680a5060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2570005fd0 tx=0x7f257000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:42:57.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.351+0000 7f256f7fe640 1 -- 172.21.15.73:0/2631360209 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f257809ae20 con 0x7f2580102690 2024-09-10T07:42:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:42:57.525+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f25801a0820 con 0x7f25680a2ba0 2024-09-10T07:42:57.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:57 smithi159 ceph-mon[35522]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:42:57.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:57 smithi159 ceph-mon[35522]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T07:42:57.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:57.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:57.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:57 smithi159 ceph-mon[35522]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:42:57.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:42:57.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:42:57.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:57 smithi102 ceph-mon[35514]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:42:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:57 smithi102 ceph-mon[35514]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T07:42:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:57 smithi102 ceph-mon[35514]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:42:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:42:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:42:58.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:58.142 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:57 smithi073 ceph-mon[30850]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:42:58.142 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:57 smithi073 ceph-mon[30850]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T07:42:58.142 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:58.142 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:58.142 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:57 smithi073 ceph-mon[30850]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:42:58.142 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:42:58.143 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:42:58.143 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:42:59.146 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:58 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:42:59.146 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:58 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:42:59.146 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:58 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:59.146 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:58 smithi073 ceph-mon[30850]: osd.2 [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] boot 2024-09-10T07:42:59.146 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:58 smithi073 ceph-mon[30850]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T07:42:59.146 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:58 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:59.147 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:58 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T07:42:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:58 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:42:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:58 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:42:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:58 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:58 smithi159 ceph-mon[35522]: osd.2 [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] boot 2024-09-10T07:42:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:58 smithi159 ceph-mon[35522]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T07:42:59.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:58 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:59.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:58 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T07:42:59.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:58 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:42:59.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:58 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:42:59.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:58 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:59.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:58 smithi102 ceph-mon[35514]: osd.2 [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] boot 2024-09-10T07:42:59.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:58 smithi102 ceph-mon[35514]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T07:42:59.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:58 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:42:59.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:58 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T07:42:59.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:59 smithi073 ceph-mon[30850]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:42:59.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:59 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T07:42:59.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:59 smithi073 ceph-mon[30850]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T07:42:59.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:42:59 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T07:43:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:59 smithi159 ceph-mon[35522]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:43:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:59 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T07:43:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:59 smithi159 ceph-mon[35522]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T07:43:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:42:59 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T07:43:00.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:59 smithi102 ceph-mon[35514]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T07:43:00.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:59 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T07:43:00.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:59 smithi102 ceph-mon[35514]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T07:43:00.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:42:59 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T07:43:00.551 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:43:00 smithi073 sudo[49850]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T07:43:00.551 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:43:00 smithi073 sudo[49850]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:00.551 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:43:00 smithi073 sudo[49850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:00.551 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:43:00 smithi073 sudo[49850]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:00.954 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:43:00 smithi073 sudo[49872]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T07:43:00.954 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:43:00 smithi073 sudo[49872]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:00.954 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:43:00 smithi073 sudo[49872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:00.955 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:43:00 smithi073 sudo[49872]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:01.077 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:43:00 smithi102 sudo[43753]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T07:43:01.077 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:43:00 smithi102 sudo[43753]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:01.077 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:43:00 smithi102 sudo[43753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:01.077 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:43:00 smithi102 sudo[43753]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:01.078 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:00 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T07:43:01.078 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:00 smithi102 ceph-mon[35514]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T07:43:01.078 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:00 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/647745029' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e"}]: dispatch 2024-09-10T07:43:01.078 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:00 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/647745029' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e"}]': finished 2024-09-10T07:43:01.078 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:00 smithi102 ceph-mon[35514]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T07:43:01.078 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:00 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:01.078 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:00 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:01.078 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:00 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3950012172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:43:01.078 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:00 smithi102 ceph-mon[35514]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:00 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T07:43:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:00 smithi073 ceph-mon[30850]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T07:43:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:00 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/647745029' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e"}]: dispatch 2024-09-10T07:43:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:00 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/647745029' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e"}]': finished 2024-09-10T07:43:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:00 smithi073 ceph-mon[30850]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T07:43:01.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:00 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:01.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:00 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:01.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:00 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3950012172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:43:01.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:00 smithi073 ceph-mon[30850]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:01.376 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:43:01 smithi102 sudo[43756]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T07:43:01.376 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:43:01 smithi102 sudo[43756]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:01.376 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:43:01 smithi102 sudo[43756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:01.376 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 07:43:01 smithi102 sudo[43756]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:01.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:00 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T07:43:01.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:00 smithi159 ceph-mon[35522]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T07:43:01.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:00 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/647745029' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e"}]: dispatch 2024-09-10T07:43:01.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:00 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/647745029' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e"}]': finished 2024-09-10T07:43:01.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:00 smithi159 ceph-mon[35522]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T07:43:01.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:00 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:01.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:00 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:01.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:00 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3950012172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:43:01.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:00 smithi159 ceph-mon[35522]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:01.595+0000 7f256f7fe640 1 -- 172.21.15.73:0/2631360209 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f257800ccf0 con 0x7f2580102690 2024-09-10T07:43:01.776 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:43:01 smithi159 sudo[44177]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T07:43:01.776 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:43:01 smithi159 sudo[44177]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:01.776 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:43:01 smithi159 sudo[44177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:01.776 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:43:01 smithi159 sudo[44177]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:02.157 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:43:01 smithi159 sudo[44180]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T07:43:02.157 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:43:01 smithi159 sudo[44180]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:02.157 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:43:01 smithi159 sudo[44180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:02.157 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 07:43:01 smithi159 sudo[44180]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:02.319 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 sudo[50113]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T07:43:02.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 sudo[50113]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:02.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 sudo[50113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:02.320 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 sudo[50113]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:02.582 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:02.582 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 ceph-mon[35522]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T07:43:02.582 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:02.582 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 ceph-mon[35522]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T07:43:02.582 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 sudo[44183]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T07:43:02.582 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 sudo[44183]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:02.582 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 sudo[44183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:02.582 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 sudo[44183]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:02.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:02.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:02 smithi102 ceph-mon[35514]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T07:43:02.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:02.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:02 smithi102 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T07:43:02.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 sudo[50300]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T07:43:02.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 sudo[50300]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:02.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 sudo[50300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:02.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 sudo[50300]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:02.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:02.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 ceph-mon[30850]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T07:43:02.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:02.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:02 smithi073 ceph-mon[30850]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T07:43:02.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 sudo[44186]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T07:43:02.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 sudo[44186]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:02.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 sudo[44186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:02.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:02 smithi159 sudo[44186]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:03.315 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 sudo[43759]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T07:43:03.315 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 sudo[43759]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:03.315 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 sudo[43759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:03.315 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 sudo[43759]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:03.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 sudo[43762]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T07:43:03.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 sudo[43762]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T07:43:03.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 sudo[43762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T07:43:03.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 sudo[43762]: pam_unix(sudo:session): session closed for user root 2024-09-10T07:43:03.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T07:43:03.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:43:03.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:03 smithi102 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T07:43:03.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T07:43:03.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:43:03.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:43:03.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:43:03.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:03 smithi159 ceph-mon[35522]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T07:43:03.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:43:03.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:43:03.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:03 smithi073 ceph-mon[30850]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T07:43:05.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:05 smithi073 ceph-mon[30850]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:05 smithi102 ceph-mon[35514]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:05 smithi159 ceph-mon[35522]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:07.775 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:07 smithi073 ceph-mon[30850]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:08.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:07 smithi102 ceph-mon[35514]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:08.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:07 smithi159 ceph-mon[35522]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:09.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:09 smithi073 ceph-mon[30850]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:09.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T07:43:09.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:09.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:09 smithi073 ceph-mon[30850]: Deploying daemon osd.3 on smithi073 2024-09-10T07:43:10.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:09 smithi102 ceph-mon[35514]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:10.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T07:43:10.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:10.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:09 smithi102 ceph-mon[35514]: Deploying daemon osd.3 on smithi073 2024-09-10T07:43:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:09 smithi159 ceph-mon[35522]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T07:43:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:09 smithi159 ceph-mon[35522]: Deploying daemon osd.3 on smithi073 2024-09-10T07:43:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:11 smithi073 ceph-mon[30850]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:11 smithi102 ceph-mon[35514]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:11 smithi159 ceph-mon[35522]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:13.820 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:13 smithi073 ceph-mon[30850]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:13 smithi102 ceph-mon[35514]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:13 smithi159 ceph-mon[35522]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:15.959 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:15 smithi159 ceph-mon[35522]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:15.959 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:15 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:15.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:15 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:15.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:15 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:15.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:15 smithi073 ceph-mon[30850]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:15.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:15 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:15.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:15 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:15.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:15 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:16.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:15 smithi102 ceph-mon[35514]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:16.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:15 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:16.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:15 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:16.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:15 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:17 smithi073 ceph-mon[30850]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:17 smithi102 ceph-mon[35514]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:17 smithi159 ceph-mon[35522]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.679+0000 7f256f7fe640 1 -- 172.21.15.73:0/2631360209 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f25801a0820 con 0x7f25680a2ba0 2024-09-10T07:43:18.679 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 3 on host 'smithi073' 2024-09-10T07:43:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25680a2ba0 msgr2=0x7f25680a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25680a2ba0 0x7f25680a5060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2570005fd0 tx=0x7f257000b390 comp rx=0 tx=0).stop 2024-09-10T07:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580102690 msgr2=0x7f258019f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580102690 0x7f258019f530 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f257800b970 tx=0x7f257800be30 comp rx=0 tx=0).stop 2024-09-10T07:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 shutdown_connections 2024-09-10T07:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25680a2ba0 0x7f25680a5060 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580102690 0x7f258019f530 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580101cd0 0x7f2580198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 --2- 172.21.15.73:0/2631360209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580100ad0 0x7f2580197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 >> 172.21.15.73:0/2631360209 conn(0x7f25800fc280 msgr2=0x7f2580069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 shutdown_connections 2024-09-10T07:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:43:18.681+0000 7f2584ebf640 1 -- 172.21.15.73:0/2631360209 wait complete. 2024-09-10T07:43:18.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:18 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:18.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:18 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:18 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:18 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:19.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:19.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:19.429 DEBUG:teuthology.orchestra.run.smithi073:osd.3> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T07:43:19.433 INFO:tasks.cephadm:Deploying osd.4 on smithi102 with /dev/vg_nvme/lv_3... 2024-09-10T07:43:19.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T07:43:19.682 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:43:19.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:19 smithi102 ceph-mon[35514]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:19.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:19 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:19.939 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:19 smithi073 ceph-mon[30850]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:19.939 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:19 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:20.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:19 smithi159 ceph-mon[35522]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:20.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:19 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:21.472 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 07:43:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T07:43:21.070+0000 7f15c5bd1640 -1 osd.3 0 log_to_monitors true 2024-09-10T07:43:21.860 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:21 smithi102 ceph-mon[35514]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:21.860 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:21 smithi102 ceph-mon[35514]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T07:43:21.890 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:21 smithi073 ceph-mon[30850]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:21.890 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:21 smithi073 ceph-mon[30850]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T07:43:22.117 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:43:22.143 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_3 2024-09-10T07:43:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:21 smithi159 ceph-mon[35522]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:21 smithi159 ceph-mon[35522]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T07:43:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:43:22.784 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:22.785 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:22.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.867+0000 7f3682622640 1 -- 172.21.15.102:0/1612315150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 msgr2=0x7f367c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:22.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.867+0000 7f3682622640 1 --2- 172.21.15.102:0/1612315150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 0x7f367c1073c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3670009900 tx=0x7f367002a410 comp rx=0 tx=0).stop 2024-09-10T07:43:22.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.867+0000 7f3682622640 1 -- 172.21.15.102:0/1612315150 shutdown_connections 2024-09-10T07:43:22.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.868+0000 7f3682622640 1 --2- 172.21.15.102:0/1612315150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f367c107900 0x7f367c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:22.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.868+0000 7f3682622640 1 --2- 172.21.15.102:0/1612315150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 0x7f367c1073c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:22.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.868+0000 7f3682622640 1 --2- 172.21.15.102:0/1612315150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f367c1026a0 0x7f367c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:22.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.868+0000 7f3682622640 1 -- 172.21.15.102:0/1612315150 >> 172.21.15.102:0/1612315150 conn(0x7f367c0fc2a0 msgr2=0x7f367c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:22.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.868+0000 7f3682622640 1 -- 172.21.15.102:0/1612315150 shutdown_connections 2024-09-10T07:43:22.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.868+0000 7f3682622640 1 -- 172.21.15.102:0/1612315150 wait complete. 2024-09-10T07:43:22.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.869+0000 7f3682622640 1 Processor -- start 2024-09-10T07:43:22.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.869+0000 7f3682622640 1 -- start start 2024-09-10T07:43:22.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.869+0000 7f3682622640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f367c1026a0 0x7f367c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:22.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.869+0000 7f3682622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 0x7f367c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:22.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.869+0000 7f3682622640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f367c107900 0x7f367c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:22.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.869+0000 7f3682622640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f367c10d880 con 0x7f367c107900 2024-09-10T07:43:22.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.869+0000 7f3682622640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f367c10d700 con 0x7f367c104fd0 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.869+0000 7f3682622640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f367c10da00 con 0x7f367c1026a0 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 0x7f367c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 0x7f367c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54642/0 (socket says 172.21.15.102:54642) 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367b7fe640 1 -- 172.21.15.102:0/3379960092 learned_addr learned my addr 172.21.15.102:0/3379960092 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f3680bbf640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f367c107900 0x7f367c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367bfff640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f367c1026a0 0x7f367c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367b7fe640 1 -- 172.21.15.102:0/3379960092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f367c1026a0 msgr2=0x7f367c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367b7fe640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f367c1026a0 0x7f367c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367b7fe640 1 -- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f367c107900 msgr2=0x7f367c19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367b7fe640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f367c107900 0x7f367c19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367b7fe640 1 -- 172.21.15.102:0/3379960092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c19fb10 con 0x7f367c104fd0 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f3680bbf640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f367c107900 0x7f367c19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:43:22.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f367b7fe640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 0x7f367c198420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3670031610 tx=0x7f36700043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:22.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f36797fa640 1 -- 172.21.15.102:0/3379960092 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367003f030 con 0x7f367c104fd0 2024-09-10T07:43:22.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367c19fda0 con 0x7f367c104fd0 2024-09-10T07:43:22.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.870+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367c1a0270 con 0x7f367c104fd0 2024-09-10T07:43:22.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.871+0000 7f36797fa640 1 -- 172.21.15.102:0/3379960092 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3670003ce0 con 0x7f367c104fd0 2024-09-10T07:43:22.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.871+0000 7f36797fa640 1 -- 172.21.15.102:0/3379960092 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670049060 con 0x7f367c104fd0 2024-09-10T07:43:22.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.872+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36680052c0 con 0x7f367c104fd0 2024-09-10T07:43:22.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.872+0000 7f36797fa640 1 -- 172.21.15.102:0/3379960092 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3670042030 con 0x7f367c104fd0 2024-09-10T07:43:22.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.873+0000 7f36797fa640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36640a2bb0 0x7f36640a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:22.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.873+0000 7f36797fa640 1 -- 172.21.15.102:0/3379960092 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7f36700ee1f0 con 0x7f367c104fd0 2024-09-10T07:43:22.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.873+0000 7f367bfff640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36640a2bb0 0x7f36640a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:22.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.874+0000 7f367bfff640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36640a2bb0 0x7f36640a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f366c005d00 tx=0x7f366c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:22.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:22.877+0000 7f36797fa640 1 -- 172.21.15.102:0/3379960092 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36700bbe40 con 0x7f367c104fd0 2024-09-10T07:43:22.972 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T07:43:22.705+0000 7f15c1331640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T07:43:22.972 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T07:43:22.710+0000 7f15bd96b640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:43:22.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:22.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:23.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:23.051+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3668000bf0 con 0x7f36640a2bb0 2024-09-10T07:43:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T07:43:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T07:43:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:43:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:23.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:23.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:23.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:23.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:23.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:23.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:23.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi073 2024-09-10T07:43:23.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi073 to 8544M 2024-09-10T07:43:23.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:23.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:43:23.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T07:43:23.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:23.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:23.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:43:23.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:43:23.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi073 2024-09-10T07:43:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi073 to 8544M 2024-09-10T07:43:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:43:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T07:43:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:24.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:24.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:43:24.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:43:24.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi073 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi073 to 8544M 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: from='osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:43:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:24.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:24 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:43:24.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:24 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:43:24.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:24 smithi073 ceph-mon[30850]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:43:24.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:24 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:24.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:24 smithi073 ceph-mon[30850]: osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] boot 2024-09-10T07:43:24.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:24 smithi073 ceph-mon[30850]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T07:43:24.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:24 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:25.060 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:24 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:43:25.061 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:24 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:43:25.061 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:24 smithi102 ceph-mon[35514]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:43:25.061 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:24 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:25.061 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:24 smithi102 ceph-mon[35514]: osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] boot 2024-09-10T07:43:25.061 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:24 smithi102 ceph-mon[35514]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T07:43:25.061 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:24 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:24 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:43:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:24 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:43:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:24 smithi159 ceph-mon[35522]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:43:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:24 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:24 smithi159 ceph-mon[35522]: osd.3 [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] boot 2024-09-10T07:43:25.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:24 smithi159 ceph-mon[35522]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T07:43:25.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:24 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:43:25.971 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:25 smithi102 ceph-mon[35514]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:25.971 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:25 smithi102 ceph-mon[35514]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T07:43:25.971 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:25 smithi102 ceph-mon[35514]: from='client.? 172.21.15.102:0/1421402931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "294eff0e-74d3-4a3c-a512-de8e6878e66d"}]: dispatch 2024-09-10T07:43:25.971 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:25 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "294eff0e-74d3-4a3c-a512-de8e6878e66d"}]: dispatch 2024-09-10T07:43:25.971 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:25 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294eff0e-74d3-4a3c-a512-de8e6878e66d"}]': finished 2024-09-10T07:43:25.972 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:25 smithi102 ceph-mon[35514]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T07:43:25.972 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:25.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:25 smithi073 ceph-mon[30850]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:25.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:25 smithi073 ceph-mon[30850]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T07:43:25.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:25 smithi073 ceph-mon[30850]: from='client.? 172.21.15.102:0/1421402931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "294eff0e-74d3-4a3c-a512-de8e6878e66d"}]: dispatch 2024-09-10T07:43:25.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:25 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "294eff0e-74d3-4a3c-a512-de8e6878e66d"}]: dispatch 2024-09-10T07:43:25.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:25 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294eff0e-74d3-4a3c-a512-de8e6878e66d"}]': finished 2024-09-10T07:43:25.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:25 smithi073 ceph-mon[30850]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T07:43:25.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:25 smithi159 ceph-mon[35522]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T07:43:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:25 smithi159 ceph-mon[35522]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T07:43:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:25 smithi159 ceph-mon[35522]: from='client.? 172.21.15.102:0/1421402931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "294eff0e-74d3-4a3c-a512-de8e6878e66d"}]: dispatch 2024-09-10T07:43:26.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:25 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "294eff0e-74d3-4a3c-a512-de8e6878e66d"}]: dispatch 2024-09-10T07:43:26.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:25 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294eff0e-74d3-4a3c-a512-de8e6878e66d"}]': finished 2024-09-10T07:43:26.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:25 smithi159 ceph-mon[35522]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T07:43:26.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:27.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:26 smithi102 ceph-mon[35514]: from='client.? 172.21.15.102:0/1871747008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:43:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:26 smithi159 ceph-mon[35522]: from='client.? 172.21.15.102:0/1871747008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:43:27.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:26 smithi073 ceph-mon[30850]: from='client.? 172.21.15.102:0/1871747008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:43:28.032 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:27 smithi073 ceph-mon[30850]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:28.032 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:27 smithi073 ceph-mon[30850]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T07:43:28.032 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:27 smithi102 ceph-mon[35514]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:27 smithi102 ceph-mon[35514]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T07:43:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:27 smithi159 ceph-mon[35522]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:27 smithi159 ceph-mon[35522]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T07:43:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:28.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:28 smithi073 ceph-mon[30850]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T07:43:28.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:28 smithi102 ceph-mon[35514]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T07:43:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:28 smithi159 ceph-mon[35522]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T07:43:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:29 smithi102 ceph-mon[35514]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:29 smithi159 ceph-mon[35522]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:30.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:29 smithi073 ceph-mon[30850]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:31.860 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:31 smithi102 ceph-mon[35514]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T07:43:32.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:31 smithi159 ceph-mon[35522]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T07:43:32.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:31 smithi073 ceph-mon[30850]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T07:43:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:33 smithi102 ceph-mon[35514]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T07:43:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:33 smithi159 ceph-mon[35522]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T07:43:34.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:33 smithi073 ceph-mon[30850]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T07:43:34.859 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T07:43:34.859 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T07:43:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T07:43:35.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:36.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:35 smithi102 ceph-mon[35514]: Deploying daemon osd.4 on smithi102 2024-09-10T07:43:36.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:35 smithi102 ceph-mon[35514]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T07:43:36.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:35 smithi159 ceph-mon[35522]: Deploying daemon osd.4 on smithi102 2024-09-10T07:43:36.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:35 smithi159 ceph-mon[35522]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T07:43:36.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:35 smithi073 ceph-mon[30850]: Deploying daemon osd.4 on smithi102 2024-09-10T07:43:36.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:35 smithi073 ceph-mon[30850]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T07:43:36.995 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:36 smithi102 ceph-mon[35514]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T07:43:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:36 smithi159 ceph-mon[35522]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T07:43:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:36 smithi073 ceph-mon[30850]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T07:43:39.792 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:39 smithi102 ceph-mon[35514]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T07:43:39.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:39 smithi073 ceph-mon[30850]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T07:43:40.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:39 smithi159 ceph-mon[35522]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T07:43:40.948 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:40 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:40.948 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:40 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:40.948 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:40 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:40.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:40 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:40.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:40 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:40.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:40 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:41.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:40 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:41.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:40 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:41.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:40 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:41.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:41 smithi102 ceph-mon[35514]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:43:41.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:41 smithi073 ceph-mon[30850]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:43:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:41 smithi159 ceph-mon[35522]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:43:43.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:43 smithi102 ceph-mon[35514]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:43.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:43.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:43.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:43.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:43.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:43.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:43 smithi073 ceph-mon[30850]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:43.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:43.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:43.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:43.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:43.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:43 smithi159 ceph-mon[35522]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:44.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:44.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:44.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.243+0000 7f36797fa640 1 -- 172.21.15.102:0/3379960092 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3668000bf0 con 0x7f36640a2bb0 2024-09-10T07:43:44.243 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 4 on host 'smithi102' 2024-09-10T07:43:44.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36640a2bb0 msgr2=0x7f36640a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:44.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36640a2bb0 0x7f36640a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f366c005d00 tx=0x7f366c00b410 comp rx=0 tx=0).stop 2024-09-10T07:43:44.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 msgr2=0x7f367c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:44.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 0x7f367c198420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3670031610 tx=0x7f36700043b0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 shutdown_connections 2024-09-10T07:43:44.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36640a2bb0 0x7f36640a5070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f367c107900 0x7f367c19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c104fd0 0x7f367c198420 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 --2- 172.21.15.102:0/3379960092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f367c1026a0 0x7f367c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 >> 172.21.15.102:0/3379960092 conn(0x7f367c0fc2a0 msgr2=0x7f367c102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:44.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.245+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 shutdown_connections 2024-09-10T07:43:44.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:43:44.246+0000 7f3682622640 1 -- 172.21.15.102:0/3379960092 wait complete. 2024-09-10T07:43:44.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:44 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:44.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:44 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:44.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:44 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:44.922 DEBUG:teuthology.orchestra.run.smithi102:osd.4> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T07:43:44.924 INFO:tasks.cephadm:Deploying osd.5 on smithi159 with /dev/vg_nvme/lv_3... 2024-09-10T07:43:44.925 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T07:43:44.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:44.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:44.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:45.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:44 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:43:45.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:44 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:45.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:44 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:45.178 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:43:46.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:45 smithi159 ceph-mon[35522]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:45 smithi102 ceph-mon[35514]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:46.142 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:45 smithi073 ceph-mon[30850]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:46.626 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 07:43:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T07:43:46.455+0000 7f1c69c30640 -1 osd.4 0 log_to_monitors true 2024-09-10T07:43:47.026 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:46 smithi159 ceph-mon[35522]: from='osd.4 [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T07:43:47.026 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:46 smithi159 ceph-mon[35522]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T07:43:47.106 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:46 smithi073 ceph-mon[30850]: from='osd.4 [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T07:43:47.106 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:46 smithi073 ceph-mon[30850]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T07:43:47.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:46 smithi102 ceph-mon[35514]: from='osd.4 [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T07:43:47.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:46 smithi102 ceph-mon[35514]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T07:43:47.720 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:43:47.748 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_3 2024-09-10T07:43:47.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:47.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T07:43:47.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T07:43:47.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:47.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='osd.4 [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:43:47.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:43:47.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:47.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:47.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:47.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:47.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:47.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:47.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:47.910 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:47.989 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:43:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T07:43:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T07:43:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='osd.4 [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:43:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:43:48.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:48.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:48.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:48.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:48.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:48.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:48.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:48.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:48.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:48.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='osd.4 [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:43:48.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:43:48.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.414+0000 7fbc506d7640 1 -- 172.21.15.159:0/3719656665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 msgr2=0x7fbc48102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.414+0000 7fbc506d7640 1 --2- 172.21.15.159:0/3719656665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 0x7fbc48102000 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009ca0 tx=0x7fbc3802a8c0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.414+0000 7fbc506d7640 1 -- 172.21.15.159:0/3719656665 shutdown_connections 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.414+0000 7fbc506d7640 1 --2- 172.21.15.159:0/3719656665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc481037c0 0x7fbc4810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.414+0000 7fbc506d7640 1 --2- 172.21.15.159:0/3719656665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48102e00 0x7fbc48103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.414+0000 7fbc506d7640 1 --2- 172.21.15.159:0/3719656665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 0x7fbc48102000 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.414+0000 7fbc506d7640 1 -- 172.21.15.159:0/3719656665 >> 172.21.15.159:0/3719656665 conn(0x7fbc480fd390 msgr2=0x7fbc480ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.414+0000 7fbc506d7640 1 -- 172.21.15.159:0/3719656665 shutdown_connections 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.414+0000 7fbc506d7640 1 -- 172.21.15.159:0/3719656665 wait complete. 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc506d7640 1 Processor -- start 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc506d7640 1 -- start start 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc506d7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 0x7fbc48197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc506d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48102e00 0x7fbc48198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc506d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc481037c0 0x7fbc4819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc506d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4810d880 con 0x7fbc481037c0 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc506d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4810d700 con 0x7fbc48102e00 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc506d7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4810da00 con 0x7fbc48101c00 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4e473640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 0x7fbc48197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4e473640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 0x7fbc48197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33740/0 (socket says 172.21.15.159:33740) 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4dc72640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48102e00 0x7fbc48198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4e473640 1 -- 172.21.15.159:0/1171262938 learned_addr learned my addr 172.21.15.159:0/1171262938 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4ec74640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc481037c0 0x7fbc4819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4e473640 1 -- 172.21.15.159:0/1171262938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48102e00 msgr2=0x7fbc48198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4e473640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48102e00 0x7fbc48198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4e473640 1 -- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc481037c0 msgr2=0x7fbc4819f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4e473640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc481037c0 0x7fbc4819f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4e473640 1 -- 172.21.15.159:0/1171262938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4819fb60 con 0x7fbc48101c00 2024-09-10T07:43:48.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4ec74640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc481037c0 0x7fbc4819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:48.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.415+0000 7fbc4e473640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 0x7fbc48197f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009bf0 tx=0x7fbc38031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.416+0000 7fbc477fe640 1 -- 172.21.15.159:0/1171262938 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3802fae0 con 0x7fbc48101c00 2024-09-10T07:43:48.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.416+0000 7fbc477fe640 1 -- 172.21.15.159:0/1171262938 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc3802fc80 con 0x7fbc48101c00 2024-09-10T07:43:48.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.416+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4819fdf0 con 0x7fbc48101c00 2024-09-10T07:43:48.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.416+0000 7fbc477fe640 1 -- 172.21.15.159:0/1171262938 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc380467e0 con 0x7fbc48101c00 2024-09-10T07:43:48.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.416+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc481a0240 con 0x7fbc48101c00 2024-09-10T07:43:48.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.417+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc48102000 con 0x7fbc48101c00 2024-09-10T07:43:48.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.418+0000 7fbc477fe640 1 -- 172.21.15.159:0/1171262938 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbc38030b30 con 0x7fbc48101c00 2024-09-10T07:43:48.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.418+0000 7fbc477fe640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbc300a2bb0 0x7fbc300a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.419+0000 7fbc477fe640 1 -- 172.21.15.159:0/1171262938 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7fbc380ef3c0 con 0x7fbc48101c00 2024-09-10T07:43:48.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.419+0000 7fbc4dc72640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbc300a2bb0 0x7fbc300a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.419+0000 7fbc4dc72640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbc300a2bb0 0x7fbc300a5070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbc48199450 tx=0x7fbc3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.423+0000 7fbc477fe640 1 -- 172.21.15.159:0/1171262938 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc380bd4b0 con 0x7fbc48101c00 2024-09-10T07:43:48.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:43:48.600+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbc48062630 con 0x7fbc300a2bb0 2024-09-10T07:43:48.876 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T07:43:48.496+0000 7f1c663c7640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T07:43:48.876 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T07:43:48.504+0000 7f1c5d9c2640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:43:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi102 2024-09-10T07:43:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-10T07:43:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:43:48.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T07:43:48.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:48.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:48.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: from='osd.4 ' entity='osd.4' 2024-09-10T07:43:48.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:43:48.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:43:48.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:49.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi102 2024-09-10T07:43:49.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-10T07:43:49.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:43:49.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T07:43:49.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:49.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:49.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: from='osd.4 ' entity='osd.4' 2024-09-10T07:43:49.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:43:49.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:43:49.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi102 2024-09-10T07:43:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-10T07:43:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:43:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T07:43:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:49.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:49.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: from='osd.4 ' entity='osd.4' 2024-09-10T07:43:49.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:43:49.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:43:49.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:49.835 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:49 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:43:49.835 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:49 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:43:49.835 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:49 smithi159 ceph-mon[35522]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:43:49.835 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:49 smithi159 ceph-mon[35522]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:49.835 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:49.836 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:49 smithi159 ceph-mon[35522]: osd.4 [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] boot 2024-09-10T07:43:49.836 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:49 smithi159 ceph-mon[35522]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T07:43:49.836 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:50.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:49 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:43:50.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:49 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:43:50.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:49 smithi102 ceph-mon[35514]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:43:50.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:49 smithi102 ceph-mon[35514]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:50.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:50.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:49 smithi102 ceph-mon[35514]: osd.4 [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] boot 2024-09-10T07:43:50.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:49 smithi102 ceph-mon[35514]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T07:43:50.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:50.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:49 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:43:50.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:49 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:43:50.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:49 smithi073 ceph-mon[30850]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:43:50.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:49 smithi073 ceph-mon[30850]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T07:43:50.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:50.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:49 smithi073 ceph-mon[30850]: osd.4 [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] boot 2024-09-10T07:43:50.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:49 smithi073 ceph-mon[30850]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T07:43:50.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:43:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:51 smithi102 ceph-mon[35514]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:51 smithi102 ceph-mon[35514]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T07:43:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:51 smithi102 ceph-mon[35514]: from='client.? 172.21.15.159:0/2546989148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71a0406f-9981-4c62-9795-e69112b5c4e0"}]: dispatch 2024-09-10T07:43:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:51 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71a0406f-9981-4c62-9795-e69112b5c4e0"}]: dispatch 2024-09-10T07:43:52.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:51 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71a0406f-9981-4c62-9795-e69112b5c4e0"}]': finished 2024-09-10T07:43:52.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:51 smithi102 ceph-mon[35514]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T07:43:52.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:43:52.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:51 smithi102 ceph-mon[35514]: from='client.? 172.21.15.159:0/3570446780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:43:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:51 smithi159 ceph-mon[35522]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:51 smithi159 ceph-mon[35522]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T07:43:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:51 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/2546989148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71a0406f-9981-4c62-9795-e69112b5c4e0"}]: dispatch 2024-09-10T07:43:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:51 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71a0406f-9981-4c62-9795-e69112b5c4e0"}]: dispatch 2024-09-10T07:43:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:51 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71a0406f-9981-4c62-9795-e69112b5c4e0"}]': finished 2024-09-10T07:43:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:51 smithi159 ceph-mon[35522]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T07:43:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:43:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:51 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/3570446780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:43:52.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:51 smithi073 ceph-mon[30850]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:52.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:51 smithi073 ceph-mon[30850]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T07:43:52.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:51 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/2546989148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71a0406f-9981-4c62-9795-e69112b5c4e0"}]: dispatch 2024-09-10T07:43:52.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:51 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71a0406f-9981-4c62-9795-e69112b5c4e0"}]: dispatch 2024-09-10T07:43:52.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:51 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71a0406f-9981-4c62-9795-e69112b5c4e0"}]': finished 2024-09-10T07:43:52.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:51 smithi073 ceph-mon[30850]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T07:43:52.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:43:52.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:51 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/3570446780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:43:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:53 smithi102 ceph-mon[35514]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:53 smithi159 ceph-mon[35522]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:53 smithi073 ceph-mon[30850]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:56.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:55 smithi159 ceph-mon[35522]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:55 smithi102 ceph-mon[35514]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:56.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:55 smithi073 ceph-mon[30850]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:56.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:56 smithi073 ceph-mon[30850]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:57.047 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:56 smithi159 ceph-mon[35522]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:57.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:56 smithi102 ceph-mon[35514]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:59.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:59 smithi159 ceph-mon[35522]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:59.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:59 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T07:43:59.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:43:59 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:43:59.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:59 smithi073 ceph-mon[30850]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:43:59.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:59 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T07:43:59.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:43:59 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:00.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:59 smithi102 ceph-mon[35514]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:00.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:59 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T07:44:00.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:43:59 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:00.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:00 smithi159 ceph-mon[35522]: Deploying daemon osd.5 on smithi159 2024-09-10T07:44:00.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:00 smithi073 ceph-mon[30850]: Deploying daemon osd.5 on smithi159 2024-09-10T07:44:01.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:00 smithi102 ceph-mon[35514]: Deploying daemon osd.5 on smithi159 2024-09-10T07:44:01.770 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:01 smithi159 ceph-mon[35522]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:01.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:01 smithi073 ceph-mon[30850]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:01 smithi102 ceph-mon[35514]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:03.771 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:03 smithi159 ceph-mon[35522]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:03.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:03 smithi073 ceph-mon[30850]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:03 smithi102 ceph-mon[35514]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:05.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:05 smithi073 ceph-mon[30850]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:05.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:05.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:05.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:06.002 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:05 smithi159 ceph-mon[35522]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:06.003 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:05 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:06.003 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:05 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:06.003 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:05 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:05 smithi102 ceph-mon[35514]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:05 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:05 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:05 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:07.956 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:07 smithi159 ceph-mon[35522]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:07.956 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:07.956 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:07.957 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:07.957 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:07.957 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:07 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:07 smithi073 ceph-mon[30850]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:07.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:07.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:07 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:08.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.001+0000 7fbc477fe640 1 -- 172.21.15.159:0/1171262938 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbc48062630 con 0x7fbc300a2bb0 2024-09-10T07:44:08.001 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 5 on host 'smithi159' 2024-09-10T07:44:08.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.003+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbc300a2bb0 msgr2=0x7fbc300a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:08.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.003+0000 7fbc506d7640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbc300a2bb0 0x7fbc300a5070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbc48199450 tx=0x7fbc3c005f90 comp rx=0 tx=0).stop 2024-09-10T07:44:08.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 msgr2=0x7fbc48197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:08.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 0x7fbc48197f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009bf0 tx=0x7fbc38031ee0 comp rx=0 tx=0).stop 2024-09-10T07:44:08.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 shutdown_connections 2024-09-10T07:44:08.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbc300a2bb0 0x7fbc300a5070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:08.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc481037c0 0x7fbc4819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:08.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48102e00 0x7fbc48198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:08.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 --2- 172.21.15.159:0/1171262938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc48101c00 0x7fbc48197f30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:08.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 >> 172.21.15.159:0/1171262938 conn(0x7fbc480fd390 msgr2=0x7fbc48106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:08.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 shutdown_connections 2024-09-10T07:44:08.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:44:08.004+0000 7fbc506d7640 1 -- 172.21.15.159:0/1171262938 wait complete. 2024-09-10T07:44:08.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:07 smithi102 ceph-mon[35514]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:08.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:08.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:08.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:08.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:08.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:07 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:08.620 DEBUG:teuthology.orchestra.run.smithi159:osd.5> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T07:44:08.623 INFO:tasks.cephadm:Deploying osd.6 on smithi073 with /dev/vg_nvme/lv_2... 2024-09-10T07:44:08.623 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T07:44:08.843 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:08 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:08.843 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:08 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:08.843 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:08 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:08.876 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:44:08.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:08 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:08.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:08 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:08.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:08 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:08 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:08 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:08 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:09.882 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:09 smithi159 ceph-mon[35522]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:09.970 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:09 smithi073 ceph-mon[30850]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:10.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:09 smithi102 ceph-mon[35514]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:11.332 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T07:44:11.071+0000 7f650e084640 -1 osd.5 0 log_to_monitors true 2024-09-10T07:44:11.355 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:44:11.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_2 2024-09-10T07:44:11.651 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='osd.5 [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:11.962 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='osd.5 [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T07:44:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T07:44:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='osd.5 [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T07:44:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T07:44:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:12.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.166+0000 7feafb210640 1 -- 172.21.15.73:0/4020190686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4100ad0 msgr2=0x7feaf4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.166+0000 7feafb210640 1 --2- 172.21.15.73:0/4020190686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4100ad0 0x7feaf4100ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feae8009900 tx=0x7feae802a410 comp rx=0 tx=0).stop 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.166+0000 7feafb210640 1 -- 172.21.15.73:0/4020190686 shutdown_connections 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.166+0000 7feafb210640 1 --2- 172.21.15.73:0/4020190686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4102690 0x7feaf4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.166+0000 7feafb210640 1 --2- 172.21.15.73:0/4020190686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf4101cd0 0x7feaf4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.166+0000 7feafb210640 1 --2- 172.21.15.73:0/4020190686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4100ad0 0x7feaf4100ed0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.166+0000 7feafb210640 1 -- 172.21.15.73:0/4020190686 >> 172.21.15.73:0/4020190686 conn(0x7feaf40fc280 msgr2=0x7feaf40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.166+0000 7feafb210640 1 -- 172.21.15.73:0/4020190686 shutdown_connections 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.166+0000 7feafb210640 1 -- 172.21.15.73:0/4020190686 wait complete. 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feafb210640 1 Processor -- start 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feafb210640 1 -- start start 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feafb210640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4100ad0 0x7feaf4104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:12.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feafb210640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf4101cd0 0x7feaf41030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feafb210640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4102690 0x7feaf41035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feafb210640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feaf410c730 con 0x7feaf4102690 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feafb210640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feaf410c5b0 con 0x7feaf4100ad0 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feafb210640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feaf410c8b0 con 0x7feaf4101cd0 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf97ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4102690 0x7feaf41035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf97ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4102690 0x7feaf41035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38054/0 (socket says 172.21.15.73:38054) 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf97ad640 1 -- 172.21.15.73:0/1198468463 learned_addr learned my addr 172.21.15.73:0/1198468463 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf8fac640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4100ad0 0x7feaf4104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf3fff640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf4101cd0 0x7feaf41030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf97ad640 1 -- 172.21.15.73:0/1198468463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf4101cd0 msgr2=0x7feaf41030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf97ad640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf4101cd0 0x7feaf41030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf97ad640 1 -- 172.21.15.73:0/1198468463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4100ad0 msgr2=0x7feaf4104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf97ad640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4100ad0 0x7feaf4104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf97ad640 1 -- 172.21.15.73:0/1198468463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf4103eb0 con 0x7feaf4102690 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.167+0000 7feaf3fff640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf4101cd0 0x7feaf41030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.168+0000 7feaf97ad640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4102690 0x7feaf41035f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feaec00cce0 tx=0x7feaec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.168+0000 7feaf1ffb640 1 -- 172.21.15.73:0/1198468463 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec00f450 con 0x7feaf4102690 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.168+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf41a1fb0 con 0x7feaf4102690 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.168+0000 7feaf1ffb640 1 -- 172.21.15.73:0/1198468463 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaec00fad0 con 0x7feaf4102690 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.168+0000 7feaf1ffb640 1 -- 172.21.15.73:0/1198468463 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec018c10 con 0x7feaf4102690 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.168+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf41a24c0 con 0x7feaf4102690 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.169+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf41a2750 con 0x7feaf4102690 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.171+0000 7feaf1ffb640 1 -- 172.21.15.73:0/1198468463 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feaec00f5f0 con 0x7feaf4102690 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.171+0000 7feaf1ffb640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7feae40a2b80 0x7feae40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.172+0000 7feaf8fac640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7feae40a2b80 0x7feae40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.172+0000 7feaf1ffb640 1 -- 172.21.15.73:0/1198468463 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4237+0+0 (secure 0 0 0) 0x7feaec0ce7c0 con 0x7feaf4102690 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.172+0000 7feaf8fac640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7feae40a2b80 0x7feae40a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feae8000c00 tx=0x7feae8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.176+0000 7feaf1ffb640 1 -- 172.21.15.73:0/1198468463 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feaec014030 con 0x7feaf4102690 2024-09-10T07:44:12.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:12.357+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7feaf41a2920 con 0x7feae40a2b80 2024-09-10T07:44:12.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi159 2024-09-10T07:44:12.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-10T07:44:12.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T07:44:12.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T07:44:12.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:12.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: from='osd.5 [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:44:12.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:44:12.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:44:12.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:44:12.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi159 2024-09-10T07:44:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-10T07:44:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T07:44:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T07:44:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: from='osd.5 [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:44:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:44:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:44:13.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:44:13.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:12 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:13.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T07:44:12.711+0000 7f65097e4640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T07:44:13.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T07:44:12.718+0000 7f6505e1e640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:44:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi159 2024-09-10T07:44:13.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-10T07:44:13.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T07:44:13.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T07:44:13.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:13.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: from='osd.5 [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:44:13.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:44:13.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:44:13.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:44:13.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:12 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:13 smithi073 ceph-mon[30850]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:44:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:13 smithi073 ceph-mon[30850]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:13 smithi073 ceph-mon[30850]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:44:13.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:13 smithi073 ceph-mon[30850]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T07:44:13.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:13.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:13 smithi102 ceph-mon[35514]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:44:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:13 smithi102 ceph-mon[35514]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:13 smithi102 ceph-mon[35514]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:44:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:13 smithi102 ceph-mon[35514]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T07:44:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:13 smithi159 ceph-mon[35522]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:44:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:13 smithi159 ceph-mon[35522]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:13 smithi159 ceph-mon[35522]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:44:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:13 smithi159 ceph-mon[35522]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T07:44:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:14.971 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:14 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:44:14.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:14 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:44:14.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:14 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:14.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:14 smithi073 ceph-mon[30850]: osd.5 [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] boot 2024-09-10T07:44:14.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:14 smithi073 ceph-mon[30850]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T07:44:14.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:14 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:15.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:14 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:44:15.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:14 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:44:15.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:14 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:15.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:14 smithi159 ceph-mon[35522]: osd.5 [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] boot 2024-09-10T07:44:15.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:14 smithi159 ceph-mon[35522]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T07:44:15.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:14 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:15.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:14 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:44:15.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:14 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:44:15.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:14 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:15.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:14 smithi102 ceph-mon[35514]: osd.5 [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] boot 2024-09-10T07:44:15.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:14 smithi102 ceph-mon[35514]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T07:44:15.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:14 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:44:16.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:15 smithi102 ceph-mon[35514]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:16.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:15 smithi102 ceph-mon[35514]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T07:44:16.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:15 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1545933618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "495420b2-33d4-4278-9ed9-fec2371e2780"}]: dispatch 2024-09-10T07:44:16.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:15 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1545933618' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "495420b2-33d4-4278-9ed9-fec2371e2780"}]': finished 2024-09-10T07:44:16.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:15 smithi102 ceph-mon[35514]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T07:44:16.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:15 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:16.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:15 smithi102 ceph-mon[35514]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T07:44:16.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:15 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:16.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:15 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/610425950' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:44:16.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:15 smithi159 ceph-mon[35522]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:16.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:15 smithi159 ceph-mon[35522]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T07:44:16.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:15 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1545933618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "495420b2-33d4-4278-9ed9-fec2371e2780"}]: dispatch 2024-09-10T07:44:16.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:15 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1545933618' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "495420b2-33d4-4278-9ed9-fec2371e2780"}]': finished 2024-09-10T07:44:16.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:15 smithi159 ceph-mon[35522]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T07:44:16.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:15 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:16.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:15 smithi159 ceph-mon[35522]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T07:44:16.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:15 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:16.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:15 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/610425950' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:44:16.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:15 smithi073 ceph-mon[30850]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T07:44:16.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:15 smithi073 ceph-mon[30850]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T07:44:16.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:15 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1545933618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "495420b2-33d4-4278-9ed9-fec2371e2780"}]: dispatch 2024-09-10T07:44:16.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:15 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1545933618' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "495420b2-33d4-4278-9ed9-fec2371e2780"}]': finished 2024-09-10T07:44:16.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:15 smithi073 ceph-mon[30850]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T07:44:16.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:15 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:16.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:15 smithi073 ceph-mon[30850]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T07:44:16.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:15 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:16.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:15 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/610425950' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:44:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:17 smithi102 ceph-mon[35514]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T07:44:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:17 smithi102 ceph-mon[35514]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:17 smithi159 ceph-mon[35522]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T07:44:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:17 smithi159 ceph-mon[35522]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:17.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:17 smithi073 ceph-mon[30850]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T07:44:17.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:17.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:17 smithi073 ceph-mon[30850]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:19 smithi073 ceph-mon[30850]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:19 smithi102 ceph-mon[35514]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:20.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:19 smithi159 ceph-mon[35522]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:21.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:21 smithi073 ceph-mon[30850]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T07:44:22.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:21 smithi102 ceph-mon[35514]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T07:44:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:21 smithi159 ceph-mon[35522]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T07:44:23.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:23 smithi073 ceph-mon[30850]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-10T07:44:23.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T07:44:23.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:23 smithi102 ceph-mon[35514]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-10T07:44:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T07:44:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:23 smithi159 ceph-mon[35522]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-10T07:44:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T07:44:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:24.957 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:24 smithi073 ceph-mon[30850]: Deploying daemon osd.6 on smithi073 2024-09-10T07:44:25.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:24 smithi102 ceph-mon[35514]: Deploying daemon osd.6 on smithi073 2024-09-10T07:44:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:24 smithi159 ceph-mon[35522]: Deploying daemon osd.6 on smithi073 2024-09-10T07:44:25.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:25 smithi073 ceph-mon[30850]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T07:44:26.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:25 smithi102 ceph-mon[35514]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T07:44:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:25 smithi159 ceph-mon[35522]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T07:44:27.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:27 smithi073 ceph-mon[30850]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-10T07:44:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:27 smithi102 ceph-mon[35514]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-10T07:44:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:27 smithi159 ceph-mon[35522]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-10T07:44:29.959 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:29 smithi073 ceph-mon[30850]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:44:29.960 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:29 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:29.960 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:29 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:29.960 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:29 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:29 smithi102 ceph-mon[35514]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:44:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:29 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:29 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:29 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:29 smithi159 ceph-mon[35522]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:44:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:29 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:29 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:29 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:31.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:31 smithi073 ceph-mon[30850]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:44:32.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:31 smithi102 ceph-mon[35514]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:44:32.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:31 smithi159 ceph-mon[35522]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:44:32.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.973+0000 7feaf1ffb640 1 -- 172.21.15.73:0/1198468463 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feaf41a2920 con 0x7feae40a2b80 2024-09-10T07:44:32.973 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 6 on host 'smithi073' 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7feae40a2b80 msgr2=0x7feae40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7feae40a2b80 0x7feae40a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feae8000c00 tx=0x7feae8031400 comp rx=0 tx=0).stop 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4102690 msgr2=0x7feaf41035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4102690 0x7feaf41035f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feaec00cce0 tx=0x7feaec00a620 comp rx=0 tx=0).stop 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 shutdown_connections 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7feae40a2b80 0x7feae40a5040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaf4102690 0x7feaf41035f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf4101cd0 0x7feaf41030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 --2- 172.21.15.73:0/1198468463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4100ad0 0x7feaf4104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 >> 172.21.15.73:0/1198468463 conn(0x7feaf40fc280 msgr2=0x7feaf40fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:32.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 shutdown_connections 2024-09-10T07:44:32.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:44:32.975+0000 7feafb210640 1 -- 172.21.15.73:0/1198468463 wait complete. 2024-09-10T07:44:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:32 smithi159 ceph-mon[35522]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:33.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:33.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:32 smithi073 ceph-mon[30850]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:33.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:32 smithi102 ceph-mon[35514]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:33.560 DEBUG:teuthology.orchestra.run.smithi073:osd.6> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T07:44:33.562 INFO:tasks.cephadm:Deploying osd.7 on smithi102 with /dev/vg_nvme/lv_2... 2024-09-10T07:44:33.563 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T07:44:33.819 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:44:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:34.164 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:34.164 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:34.164 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:34.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:34.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:34.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:34 smithi159 ceph-mon[35522]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:35.162 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:34 smithi102 ceph-mon[35514]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:34 smithi073 ceph-mon[30850]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:35.899 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 07:44:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T07:44:35.537+0000 7f386224b640 -1 osd.6 0 log_to_monitors true 2024-09-10T07:44:36.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:35 smithi159 ceph-mon[35522]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T07:44:36.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:35 smithi073 ceph-mon[30850]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T07:44:36.257 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:35 smithi102 ceph-mon[35514]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T07:44:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:44:36.287 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_2 2024-09-10T07:44:36.543 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:44:37.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.031+0000 7f8298ace640 1 -- 172.21.15.102:0/2530105334 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294100ad0 msgr2=0x7f8294100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:37.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.031+0000 7f8298ace640 1 --2- 172.21.15.102:0/2530105334 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294100ad0 0x7f8294100ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f828c009900 tx=0x7f828c02a410 comp rx=0 tx=0).stop 2024-09-10T07:44:37.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.031+0000 7f8298ace640 1 -- 172.21.15.102:0/2530105334 shutdown_connections 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.031+0000 7f8298ace640 1 --2- 172.21.15.102:0/2530105334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8294102690 0x7f8294108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.031+0000 7f8298ace640 1 --2- 172.21.15.102:0/2530105334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8294101cd0 0x7f8294102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.031+0000 7f8298ace640 1 --2- 172.21.15.102:0/2530105334 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294100ad0 0x7f8294100ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.031+0000 7f8298ace640 1 -- 172.21.15.102:0/2530105334 >> 172.21.15.102:0/2530105334 conn(0x7f82940fc280 msgr2=0x7f82940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.031+0000 7f8298ace640 1 -- 172.21.15.102:0/2530105334 shutdown_connections 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.031+0000 7f8298ace640 1 -- 172.21.15.102:0/2530105334 wait complete. 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8298ace640 1 Processor -- start 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8298ace640 1 -- start start 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8298ace640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8294100ad0 0x7f829406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8298ace640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8294101cd0 0x7f829419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8298ace640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294102690 0x7f829419f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8298ace640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f829410c750 con 0x7f8294101cd0 2024-09-10T07:44:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8298ace640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f829410c5d0 con 0x7f8294102690 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8298ace640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f829410c8d0 con 0x7f8294100ad0 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8292d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294102690 0x7f829419f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8291d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8294101cd0 0x7f829419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8292d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294102690 0x7f829419f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34894/0 (socket says 172.21.15.102:34894) 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f8292d9d640 1 -- 172.21.15.102:0/3330339608 learned_addr learned my addr 172.21.15.102:0/3330339608 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.032+0000 7f829259c640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8294100ad0 0x7f829406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f8292d9d640 1 -- 172.21.15.102:0/3330339608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8294100ad0 msgr2=0x7f829406aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f8292d9d640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8294100ad0 0x7f829406aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f8292d9d640 1 -- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8294101cd0 msgr2=0x7f829419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f8292d9d640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8294101cd0 0x7f829419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f8292d9d640 1 -- 172.21.15.102:0/3330339608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829419fb80 con 0x7f8294102690 2024-09-10T07:44:37.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f8291d9b640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8294101cd0 0x7f829419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f8292d9d640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294102690 0x7f829419f270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f828400cce0 tx=0x7f828400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f82837fe640 1 -- 172.21.15.102:0/3330339608 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828400f450 con 0x7f8294102690 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829419fe10 con 0x7f8294102690 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f82837fe640 1 -- 172.21.15.102:0/3330339608 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f828400fad0 con 0x7f8294102690 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f82837fe640 1 -- 172.21.15.102:0/3330339608 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284018c10 con 0x7f8294102690 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.033+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82941a02d0 con 0x7f8294102690 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.034+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8294107ed0 con 0x7f8294102690 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.036+0000 7f82837fe640 1 -- 172.21.15.102:0/3330339608 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f828400f5f0 con 0x7f8294102690 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.037+0000 7f82837fe640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f827c0a2b80 0x7f827c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.037+0000 7f82837fe640 1 -- 172.21.15.102:0/3330339608 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7f82840ce850 con 0x7f8294102690 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.037+0000 7f829259c640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f827c0a2b80 0x7f827c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.037+0000 7f829259c640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f827c0a2b80 0x7f827c0a5040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f828c005ab0 tx=0x7f828c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:37.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.041+0000 7f82837fe640 1 -- 172.21.15.102:0/3330339608 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8284014030 con 0x7f8294102690 2024-09-10T07:44:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T07:44:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T07:44:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:44:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi073 2024-09-10T07:44:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:37.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:37.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi073 to 5696M 2024-09-10T07:44:37.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:37.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:37.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:36 smithi102 ceph-mon[35514]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:37.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:37.222+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8294062630 con 0x7f827c0a2b80 2024-09-10T07:44:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T07:44:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T07:44:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:44:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi073 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi073 to 5696M 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:36 smithi073 ceph-mon[30850]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T07:44:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T07:44:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:44:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi073 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi073 to 5696M 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:37.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:36 smithi159 ceph-mon[35522]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:37.972 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T07:44:37.709+0000 7f385d9ab640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T07:44:37.972 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T07:44:37.728+0000 7f3855fdd640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' 2024-09-10T07:44:37.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:44:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T07:44:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:44:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:44:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:44:38.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:38.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' 2024-09-10T07:44:38.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:44:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T07:44:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:44:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:44:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:44:38.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:38.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: from='osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745]' entity='osd.6' 2024-09-10T07:44:38.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:38.948 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:38 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:44:38.948 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:38 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:44:38.948 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:38 smithi102 ceph-mon[35514]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:38.949 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:38 smithi102 ceph-mon[35514]: osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] boot 2024-09-10T07:44:38.949 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:38 smithi102 ceph-mon[35514]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T07:44:38.949 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:39.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:38 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:44:39.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:38 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:44:39.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:38 smithi073 ceph-mon[30850]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:39.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:38 smithi073 ceph-mon[30850]: osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] boot 2024-09-10T07:44:39.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:38 smithi073 ceph-mon[30850]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T07:44:39.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:38 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:44:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:38 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:44:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:38 smithi159 ceph-mon[35522]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T07:44:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:38 smithi159 ceph-mon[35522]: osd.6 [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] boot 2024-09-10T07:44:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:38 smithi159 ceph-mon[35522]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T07:44:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:44:40.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:39 smithi073 ceph-mon[30850]: from='client.? 172.21.15.102:0/3086374868' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4674c7d2-204a-4a52-aaa8-0e242e9daa80"}]: dispatch 2024-09-10T07:44:40.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:39 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4674c7d2-204a-4a52-aaa8-0e242e9daa80"}]: dispatch 2024-09-10T07:44:40.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:39 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4674c7d2-204a-4a52-aaa8-0e242e9daa80"}]': finished 2024-09-10T07:44:40.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:39 smithi073 ceph-mon[30850]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T07:44:40.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:39 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:44:40.259 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:39 smithi102 ceph-mon[35514]: from='client.? 172.21.15.102:0/3086374868' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4674c7d2-204a-4a52-aaa8-0e242e9daa80"}]: dispatch 2024-09-10T07:44:40.259 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:39 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4674c7d2-204a-4a52-aaa8-0e242e9daa80"}]: dispatch 2024-09-10T07:44:40.260 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:39 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4674c7d2-204a-4a52-aaa8-0e242e9daa80"}]': finished 2024-09-10T07:44:40.260 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:39 smithi102 ceph-mon[35514]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T07:44:40.260 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:39 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:44:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:39 smithi159 ceph-mon[35522]: from='client.? 172.21.15.102:0/3086374868' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4674c7d2-204a-4a52-aaa8-0e242e9daa80"}]: dispatch 2024-09-10T07:44:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:39 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4674c7d2-204a-4a52-aaa8-0e242e9daa80"}]: dispatch 2024-09-10T07:44:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:39 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4674c7d2-204a-4a52-aaa8-0e242e9daa80"}]': finished 2024-09-10T07:44:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:39 smithi159 ceph-mon[35522]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T07:44:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:39 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:44:41.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:40 smithi073 ceph-mon[30850]: from='client.? 172.21.15.102:0/193315555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:44:41.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:40 smithi073 ceph-mon[30850]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:41.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:40 smithi102 ceph-mon[35514]: from='client.? 172.21.15.102:0/193315555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:44:41.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:40 smithi102 ceph-mon[35514]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:41.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:40 smithi159 ceph-mon[35522]: from='client.? 172.21.15.102:0/193315555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:44:41.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:40 smithi159 ceph-mon[35522]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:43.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:43 smithi073 ceph-mon[30850]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:43 smithi102 ceph-mon[35514]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:43 smithi159 ceph-mon[35522]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:45.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:45 smithi102 ceph-mon[35514]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:45.959 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:45 smithi159 ceph-mon[35522]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:45.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:45 smithi073 ceph-mon[30850]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:47.846 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:47 smithi102 ceph-mon[35514]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:47.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:47 smithi073 ceph-mon[30850]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:48.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:47 smithi159 ceph-mon[35522]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T07:44:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:48.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T07:44:48.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:49.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T07:44:49.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:49 smithi102 ceph-mon[35514]: Deploying daemon osd.7 on smithi102 2024-09-10T07:44:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:49 smithi102 ceph-mon[35514]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:49.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:49 smithi073 ceph-mon[30850]: Deploying daemon osd.7 on smithi102 2024-09-10T07:44:49.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:49 smithi073 ceph-mon[30850]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:50.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:49 smithi159 ceph-mon[35522]: Deploying daemon osd.7 on smithi102 2024-09-10T07:44:50.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:49 smithi159 ceph-mon[35522]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:51.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:51 smithi102 ceph-mon[35514]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:51.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:51 smithi073 ceph-mon[30850]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:51 smithi159 ceph-mon[35522]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:53.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:53 smithi102 ceph-mon[35514]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:53.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:53 smithi073 ceph-mon[30850]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:53 smithi159 ceph-mon[35522]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:54.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:54 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:54.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:54 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:54.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:54 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:54.975 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:54 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:54.976 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:54 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:54.976 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:54 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:55.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:54 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:55.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:54 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:55.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:54 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:55.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:55 smithi102 ceph-mon[35514]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:55.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:55 smithi073 ceph-mon[30850]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:56.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:55 smithi159 ceph-mon[35522]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:57.906 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:57 smithi102 ceph-mon[35514]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:57.906 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:57.907 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:57.907 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:57.907 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:57.907 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.947+0000 7f82837fe640 1 -- 172.21.15.102:0/3330339608 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8294062630 con 0x7f827c0a2b80 2024-09-10T07:44:57.949 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 7 on host 'smithi102' 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f827c0a2b80 msgr2=0x7f827c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f827c0a2b80 0x7f827c0a5040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f828c005ab0 tx=0x7f828c000bc0 comp rx=0 tx=0).stop 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294102690 msgr2=0x7f829419f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294102690 0x7f829419f270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f828400cce0 tx=0x7f828400a620 comp rx=0 tx=0).stop 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 shutdown_connections 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f827c0a2b80 0x7f827c0a5040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294102690 0x7f829419f270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8294101cd0 0x7f829419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 --2- 172.21.15.102:0/3330339608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8294100ad0 0x7f829406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:57.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 >> 172.21.15.102:0/3330339608 conn(0x7f82940fc280 msgr2=0x7f82941050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 shutdown_connections 2024-09-10T07:44:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:44:57.950+0000 7f8298ace640 1 -- 172.21.15.102:0/3330339608 wait complete. 2024-09-10T07:44:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:57 smithi073 ceph-mon[30850]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:57.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:57 smithi159 ceph-mon[35522]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:44:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:44:58.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:58.622 DEBUG:teuthology.orchestra.run.smithi102:osd.7> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T07:44:58.625 INFO:tasks.cephadm:Deploying osd.8 on smithi159 with /dev/vg_nvme/lv_2... 2024-09-10T07:44:58.625 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T07:44:58.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:58 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:58.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:58 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:58.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:58 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:58.881 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:44:58.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:58 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:58.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:58 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:58.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:58 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:58.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:58 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:44:58.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:58 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:58.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:58 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:44:59.749 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:44:59 smithi102 ceph-mon[35514]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:44:59.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:44:59 smithi073 ceph-mon[30850]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:45:00.040 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:44:59 smithi159 ceph-mon[35522]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:45:00.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:00 smithi102 ceph-mon[35514]: from='osd.7 [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T07:45:00.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:00 smithi102 ceph-mon[35514]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T07:45:00.877 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 07:45:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T07:45:00.571+0000 7fef6fe84640 -1 osd.7 0 log_to_monitors true 2024-09-10T07:45:00.904 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:00 smithi159 ceph-mon[35522]: from='osd.7 [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T07:45:00.904 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:00 smithi159 ceph-mon[35522]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T07:45:00.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:00 smithi073 ceph-mon[30850]: from='osd.7 [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T07:45:00.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:00 smithi073 ceph-mon[30850]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T07:45:01.503 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:45:01.530 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_2 2024-09-10T07:45:01.783 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:45:01.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='osd.7 [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:01.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:01.810 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:01.810 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:01.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='osd.7 [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:01.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:01.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:01.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:45:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T07:45:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T07:45:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='osd.7 [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:45:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:45:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:02.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.230+0000 7f855eead640 1 -- 172.21.15.159:0/1263729835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85581038b0 msgr2=0x7f855810a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:02.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.230+0000 7f855eead640 1 --2- 172.21.15.159:0/1263729835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85581038b0 0x7f855810a140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8550009cd0 tx=0x7f855002a8e0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.231+0000 7f855eead640 1 -- 172.21.15.159:0/1263729835 shutdown_connections 2024-09-10T07:45:02.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.231+0000 7f855eead640 1 --2- 172.21.15.159:0/1263729835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85581038b0 0x7f855810a140 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.231+0000 7f855eead640 1 --2- 172.21.15.159:0/1263729835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8558102ef0 0x7f8558103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.231+0000 7f855eead640 1 --2- 172.21.15.159:0/1263729835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85580fff10 0x7f8558100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.231+0000 7f855eead640 1 -- 172.21.15.159:0/1263729835 >> 172.21.15.159:0/1263729835 conn(0x7f85580fba80 msgr2=0x7f85580fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.231+0000 7f855eead640 1 -- 172.21.15.159:0/1263729835 shutdown_connections 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.231+0000 7f855eead640 1 -- 172.21.15.159:0/1263729835 wait complete. 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.231+0000 7f855eead640 1 Processor -- start 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.231+0000 7f855eead640 1 -- start start 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f855eead640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85580fff10 0x7f8558197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f855eead640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8558102ef0 0x7f8558198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f855eead640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85581038b0 0x7f855819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f855eead640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f855810d8d0 con 0x7f85580fff10 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f855eead640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f855810d750 con 0x7f8558102ef0 2024-09-10T07:45:02.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f855eead640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f855810da50 con 0x7f85581038b0 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f8557fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8558102ef0 0x7f8558198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f855d44a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85581038b0 0x7f855819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f8557fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8558102ef0 0x7f8558198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.159:42762/0 (socket says 172.21.15.159:42762) 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f8557fff640 1 -- 172.21.15.159:0/1064119390 learned_addr learned my addr 172.21.15.159:0/1064119390 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f855cc49640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85580fff10 0x7f8558197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f8557fff640 1 -- 172.21.15.159:0/1064119390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85581038b0 msgr2=0x7f855819f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f8557fff640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85581038b0 0x7f855819f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f8557fff640 1 -- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85580fff10 msgr2=0x7f8558197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f8557fff640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85580fff10 0x7f8558197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f8557fff640 1 -- 172.21.15.159:0/1064119390 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855819fb20 con 0x7f8558102ef0 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f855d44a640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85581038b0 0x7f855819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.232+0000 7f8557fff640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8558102ef0 0x7f8558198430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f854400e9f0 tx=0x7f854400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:02.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.233+0000 7f8555ffb640 1 -- 172.21.15.159:0/1064119390 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854400cd80 con 0x7f8558102ef0 2024-09-10T07:45:02.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.233+0000 7f8555ffb640 1 -- 172.21.15.159:0/1064119390 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8544005500 con 0x7f8558102ef0 2024-09-10T07:45:02.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.233+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855819fe10 con 0x7f8558102ef0 2024-09-10T07:45:02.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.233+0000 7f8555ffb640 1 -- 172.21.15.159:0/1064119390 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544010690 con 0x7f8558102ef0 2024-09-10T07:45:02.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.233+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85581a0270 con 0x7f8558102ef0 2024-09-10T07:45:02.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.234+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85581090f0 con 0x7f8558102ef0 2024-09-10T07:45:02.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.236+0000 7f8555ffb640 1 -- 172.21.15.159:0/1064119390 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f85440046c0 con 0x7f8558102ef0 2024-09-10T07:45:02.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.236+0000 7f8555ffb640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f85480a2bb0 0x7f85480a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.236+0000 7f8555ffb640 1 -- 172.21.15.159:0/1064119390 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7f85440ce760 con 0x7f8558102ef0 2024-09-10T07:45:02.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.237+0000 7f855cc49640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f85480a2bb0 0x7f85480a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.237+0000 7f855cc49640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f85480a2bb0 0x7f85480a5070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8558069d70 tx=0x7f854c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:02.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.241+0000 7f8555ffb640 1 -- 172.21.15.159:0/1064119390 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f854409c340 con 0x7f8558102ef0 2024-09-10T07:45:02.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:02.419+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8558062630 con 0x7f85480a2bb0 2024-09-10T07:45:02.876 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T07:45:02.537+0000 7fef6b5e4640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T07:45:02.876 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T07:45:02.553+0000 7fef63c16640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:45:02.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi102 2024-09-10T07:45:02.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-10T07:45:02.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:45:02.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T07:45:02.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:02.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:02.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:45:02.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:45:02.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:02.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:02 smithi102 ceph-mon[35514]: from='osd.7 ' entity='osd.7' 2024-09-10T07:45:02.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi102 2024-09-10T07:45:02.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-10T07:45:02.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:45:02.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T07:45:02.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:02.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:02.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:45:02.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:45:02.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:02.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:02 smithi073 ceph-mon[30850]: from='osd.7 ' entity='osd.7' 2024-09-10T07:45:03.047 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi102 2024-09-10T07:45:03.048 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-10T07:45:03.048 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:45:03.048 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T07:45:03.048 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:03.048 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:03.048 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:45:03.048 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:45:03.048 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:03.048 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:02 smithi159 ceph-mon[35522]: from='osd.7 ' entity='osd.7' 2024-09-10T07:45:03.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:03 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:45:03.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:03 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:45:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:03 smithi159 ceph-mon[35522]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:45:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:03 smithi159 ceph-mon[35522]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:45:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:03 smithi159 ceph-mon[35522]: osd.7 [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] boot 2024-09-10T07:45:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:03 smithi159 ceph-mon[35522]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T07:45:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:03 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:45:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:03 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:45:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:03 smithi102 ceph-mon[35514]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:45:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:03 smithi102 ceph-mon[35514]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:45:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:03 smithi102 ceph-mon[35514]: osd.7 [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] boot 2024-09-10T07:45:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:03 smithi102 ceph-mon[35514]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T07:45:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:03 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:45:04.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:03 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:45:04.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:03 smithi073 ceph-mon[30850]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:45:04.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:03 smithi073 ceph-mon[30850]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T07:45:04.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:04.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:03 smithi073 ceph-mon[30850]: osd.7 [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] boot 2024-09-10T07:45:04.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:03 smithi073 ceph-mon[30850]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T07:45:04.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:45:05.003 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:04 smithi159 ceph-mon[35522]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T07:45:05.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:04 smithi102 ceph-mon[35514]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T07:45:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:04 smithi073 ceph-mon[30850]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T07:45:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:05 smithi102 ceph-mon[35514]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:05 smithi102 ceph-mon[35514]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T07:45:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:05 smithi102 ceph-mon[35514]: from='client.? 172.21.15.159:0/84055983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c526c9b3-de80-4151-b6e2-2177cc83b83a"}]: dispatch 2024-09-10T07:45:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:05 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c526c9b3-de80-4151-b6e2-2177cc83b83a"}]: dispatch 2024-09-10T07:45:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:05 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c526c9b3-de80-4151-b6e2-2177cc83b83a"}]': finished 2024-09-10T07:45:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:05 smithi102 ceph-mon[35514]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T07:45:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:05 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:06.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:05 smithi102 ceph-mon[35514]: from='client.? 172.21.15.159:0/3760859780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:45:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:05 smithi159 ceph-mon[35522]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:05 smithi159 ceph-mon[35522]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T07:45:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:05 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/84055983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c526c9b3-de80-4151-b6e2-2177cc83b83a"}]: dispatch 2024-09-10T07:45:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:05 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c526c9b3-de80-4151-b6e2-2177cc83b83a"}]: dispatch 2024-09-10T07:45:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:05 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c526c9b3-de80-4151-b6e2-2177cc83b83a"}]': finished 2024-09-10T07:45:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:05 smithi159 ceph-mon[35522]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T07:45:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:05 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:05 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/3760859780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:45:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:05 smithi073 ceph-mon[30850]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:05 smithi073 ceph-mon[30850]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T07:45:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:05 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/84055983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c526c9b3-de80-4151-b6e2-2177cc83b83a"}]: dispatch 2024-09-10T07:45:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:05 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c526c9b3-de80-4151-b6e2-2177cc83b83a"}]: dispatch 2024-09-10T07:45:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:05 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c526c9b3-de80-4151-b6e2-2177cc83b83a"}]': finished 2024-09-10T07:45:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:05 smithi073 ceph-mon[30850]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T07:45:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:05 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:06.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:05 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/3760859780' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:45:07.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:06 smithi102 ceph-mon[35514]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T07:45:07.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:06 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:07.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:06 smithi102 ceph-mon[35514]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:07.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:06 smithi159 ceph-mon[35522]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T07:45:07.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:06 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:07.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:06 smithi159 ceph-mon[35522]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:07.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:06 smithi073 ceph-mon[30850]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T07:45:07.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:07.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:06 smithi073 ceph-mon[30850]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:09.899 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:09 smithi159 ceph-mon[35522]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:09.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:09 smithi073 ceph-mon[30850]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:10.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:09 smithi102 ceph-mon[35514]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:11.850 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:11 smithi159 ceph-mon[35522]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:11 smithi073 ceph-mon[30850]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:11 smithi102 ceph-mon[35514]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:13.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:13 smithi159 ceph-mon[35522]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:13.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T07:45:13.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:13 smithi073 ceph-mon[30850]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T07:45:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:13 smithi102 ceph-mon[35514]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T07:45:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:14.784 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:14 smithi159 ceph-mon[35522]: Deploying daemon osd.8 on smithi159 2024-09-10T07:45:14.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:14 smithi073 ceph-mon[30850]: Deploying daemon osd.8 on smithi159 2024-09-10T07:45:15.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:14 smithi102 ceph-mon[35514]: Deploying daemon osd.8 on smithi159 2024-09-10T07:45:15.927 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:15 smithi159 ceph-mon[35522]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:15.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:15 smithi073 ceph-mon[30850]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:16.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:15 smithi102 ceph-mon[35514]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:17.882 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:17 smithi159 ceph-mon[35522]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:17 smithi073 ceph-mon[30850]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:17 smithi102 ceph-mon[35514]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:19.793 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:19 smithi159 ceph-mon[35522]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:19.793 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:19 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:19.793 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:19 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:19.793 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:19 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:19 smithi073 ceph-mon[30850]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:19 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:19 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:19 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:19 smithi102 ceph-mon[35514]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:19 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:19 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:19 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:21.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:21 smithi159 ceph-mon[35522]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:21.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:21 smithi073 ceph-mon[30850]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:22.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:21 smithi102 ceph-mon[35514]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:22.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.781+0000 7f8555ffb640 1 -- 172.21.15.159:0/1064119390 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8558062630 con 0x7f85480a2bb0 2024-09-10T07:45:22.782 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 8 on host 'smithi159' 2024-09-10T07:45:22.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f85480a2bb0 msgr2=0x7f85480a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f85480a2bb0 0x7f85480a5070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8558069d70 tx=0x7f854c00b390 comp rx=0 tx=0).stop 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8558102ef0 msgr2=0x7f8558198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8558102ef0 0x7f8558198430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f854400e9f0 tx=0x7f854400edf0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 shutdown_connections 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f85480a2bb0 0x7f85480a5070 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85581038b0 0x7f855819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8558102ef0 0x7f8558198430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 --2- 172.21.15.159:0/1064119390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85580fff10 0x7f8558197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 >> 172.21.15.159:0/1064119390 conn(0x7f85580fba80 msgr2=0x7f85581062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 shutdown_connections 2024-09-10T07:45:22.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:45:22.784+0000 7f855eead640 1 -- 172.21.15.159:0/1064119390 wait complete. 2024-09-10T07:45:23.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:23.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:23.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:22 smithi159 ceph-mon[35522]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:23.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:23.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.086 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:22 smithi102 ceph-mon[35514]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:23.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:22 smithi073 ceph-mon[30850]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:23.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:23.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:23.370 DEBUG:teuthology.orchestra.run.smithi159:osd.8> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T07:45:23.372 INFO:tasks.cephadm:Deploying osd.9 on smithi073 with /dev/vg_nvme/lv_1... 2024-09-10T07:45:23.372 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T07:45:23.627 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:45:24.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 07:45:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T07:45:24.872+0000 7f801124c640 -1 osd.8 0 log_to_monitors true 2024-09-10T07:45:25.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:25 smithi073 ceph-mon[30850]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:25.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:25 smithi073 ceph-mon[30850]: from='osd.8 [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T07:45:25.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:25 smithi073 ceph-mon[30850]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T07:45:25.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:25 smithi159 ceph-mon[35522]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:25.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:25 smithi159 ceph-mon[35522]: from='osd.8 [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T07:45:25.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:25 smithi159 ceph-mon[35522]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T07:45:26.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:25 smithi102 ceph-mon[35514]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:26.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:25 smithi102 ceph-mon[35514]: from='osd.8 [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T07:45:26.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:25 smithi102 ceph-mon[35514]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T07:45:26.382 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:45:26.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_1 2024-09-10T07:45:26.674 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:45:26.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T07:45:26.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T07:45:26.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:26.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='osd.8 [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:26.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:26 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:26.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T07:45:26.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='osd.8 [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:26.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:26 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.117+0000 7fb51560d640 1 -- 172.21.15.73:0/3009692742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510105030 msgr2=0x7fb510107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.117+0000 7fb51560d640 1 --2- 172.21.15.73:0/3009692742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510105030 0x7fb510107420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb504009900 tx=0x7fb50402a410 comp rx=0 tx=0).stop 2024-09-10T07:45:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.117+0000 7fb51560d640 1 -- 172.21.15.73:0/3009692742 shutdown_connections 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.117+0000 7fb51560d640 1 --2- 172.21.15.73:0/3009692742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb510107960 0x7fb510109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.117+0000 7fb51560d640 1 --2- 172.21.15.73:0/3009692742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510105030 0x7fb510107420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.117+0000 7fb51560d640 1 --2- 172.21.15.73:0/3009692742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb510102700 0x7fb510104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.117+0000 7fb51560d640 1 -- 172.21.15.73:0/3009692742 >> 172.21.15.73:0/3009692742 conn(0x7fb5100fc280 msgr2=0x7fb5100fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.117+0000 7fb51560d640 1 -- 172.21.15.73:0/3009692742 shutdown_connections 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.117+0000 7fb51560d640 1 -- 172.21.15.73:0/3009692742 wait complete. 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb51560d640 1 Processor -- start 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb51560d640 1 -- start start 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb51560d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb510102700 0x7fb510102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb51560d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb510105030 0x7fb5101006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb51560d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510107960 0x7fb510100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb51560d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010d830 con 0x7fb510107960 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb51560d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010d6b0 con 0x7fb510102700 2024-09-10T07:45:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb51560d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010d9b0 con 0x7fb510105030 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb50f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510107960 0x7fb510100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb50f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510107960 0x7fb510100bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38342/0 (socket says 172.21.15.73:38342) 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb50f7fe640 1 -- 172.21.15.73:0/3158754728 learned_addr learned my addr 172.21.15.73:0/3158754728 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.118+0000 7fb50e7fc640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb510105030 0x7fb5101006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb50effd640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb510102700 0x7fb510102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb50f7fe640 1 -- 172.21.15.73:0/3158754728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb510105030 msgr2=0x7fb5101006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb50f7fe640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb510105030 0x7fb5101006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb50f7fe640 1 -- 172.21.15.73:0/3158754728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb510102700 msgr2=0x7fb510102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb50f7fe640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb510102700 0x7fb510102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb50f7fe640 1 -- 172.21.15.73:0/3158754728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5101014b0 con 0x7fb510107960 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb50effd640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb510102700 0x7fb510102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb50f7fe640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510107960 0x7fb510100bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb50800cce0 tx=0x7fb50800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb4f7fff640 1 -- 172.21.15.73:0/3158754728 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50800f450 con 0x7fb510107960 2024-09-10T07:45:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb4f7fff640 1 -- 172.21.15.73:0/3158754728 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb50800fad0 con 0x7fb510107960 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5101a1ff0 con 0x7fb510107960 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb4f7fff640 1 -- 172.21.15.73:0/3158754728 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508018c10 con 0x7fb510107960 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.119+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5101a24b0 con 0x7fb510107960 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.120+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5100fdd70 con 0x7fb510107960 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.121+0000 7fb4f7fff640 1 -- 172.21.15.73:0/3158754728 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb50800f5f0 con 0x7fb510107960 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.122+0000 7fb4f7fff640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb4f80a2b80 0x7fb4f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.122+0000 7fb50effd640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb4f80a2b80 0x7fb4f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.122+0000 7fb4f7fff640 1 -- 172.21.15.73:0/3158754728 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5549+0+0 (secure 0 0 0) 0x7fb5080ceca0 con 0x7fb510107960 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.122+0000 7fb50effd640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb4f80a2b80 0x7fb4f80a5040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5000058c0 tx=0x7fb500005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.126+0000 7fb4f7fff640 1 -- 172.21.15.73:0/3158754728 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb508014030 con 0x7fb510107960 2024-09-10T07:45:27.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T07:45:26.703+0000 7f800d9e3640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T07:45:27.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T07:45:26.713+0000 7f8008fe6640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:45:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T07:45:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T07:45:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='osd.8 [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:45:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:45:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:27.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:27.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:27.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:27.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:27.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:27.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:27.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:26 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:27.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:27.304+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb510062630 con 0x7fb4f80a2b80 2024-09-10T07:45:27.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi159 2024-09-10T07:45:27.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-10T07:45:27.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:27.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:45:27.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T07:45:27.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:27.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:27.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:45:27.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:45:27.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi159 2024-09-10T07:45:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-10T07:45:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:45:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T07:45:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:45:28.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:45:28.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi159 2024-09-10T07:45:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-10T07:45:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:45:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T07:45:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:45:28.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:45:28.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:28.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:28 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:45:28.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:28 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:45:28.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:28 smithi073 ceph-mon[30850]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:45:28.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:28 smithi073 ceph-mon[30850]: osd.8 [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] boot 2024-09-10T07:45:28.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:28 smithi073 ceph-mon[30850]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T07:45:28.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:28 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:45:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:28 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:45:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:28 smithi102 ceph-mon[35514]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:45:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:28 smithi102 ceph-mon[35514]: osd.8 [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] boot 2024-09-10T07:45:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:28 smithi102 ceph-mon[35514]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T07:45:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:28 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:45:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:28 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:45:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:28 smithi159 ceph-mon[35522]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:45:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:28 smithi159 ceph-mon[35522]: osd.8 [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] boot 2024-09-10T07:45:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:28 smithi159 ceph-mon[35522]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T07:45:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:45:29.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:29 smithi073 ceph-mon[30850]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:29.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:29 smithi073 ceph-mon[30850]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T07:45:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:29 smithi102 ceph-mon[35514]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:29 smithi102 ceph-mon[35514]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T07:45:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:29 smithi159 ceph-mon[35522]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-10T07:45:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:29 smithi159 ceph-mon[35522]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T07:45:31.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:30 smithi102 ceph-mon[35514]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T07:45:31.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:30 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/4177765850' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2"}]: dispatch 2024-09-10T07:45:31.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:30 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/4177765850' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2"}]': finished 2024-09-10T07:45:31.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:30 smithi102 ceph-mon[35514]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T07:45:31.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:30 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:31.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:30 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3761155201' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:45:31.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:30 smithi159 ceph-mon[35522]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T07:45:31.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:30 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/4177765850' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2"}]: dispatch 2024-09-10T07:45:31.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:30 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/4177765850' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2"}]': finished 2024-09-10T07:45:31.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:30 smithi159 ceph-mon[35522]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T07:45:31.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:30 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:31.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:30 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3761155201' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:45:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:30 smithi073 ceph-mon[30850]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T07:45:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:30 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4177765850' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2"}]: dispatch 2024-09-10T07:45:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:30 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4177765850' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2"}]': finished 2024-09-10T07:45:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:30 smithi073 ceph-mon[30850]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T07:45:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:30 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:30 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3761155201' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:45:32.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:31 smithi102 ceph-mon[35514]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:32.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:31 smithi102 ceph-mon[35514]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T07:45:32.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:31 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:32.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:31 smithi159 ceph-mon[35522]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:32.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:31 smithi159 ceph-mon[35522]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T07:45:32.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:31 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:32.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:31 smithi073 ceph-mon[30850]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:32.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:31 smithi073 ceph-mon[30850]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T07:45:32.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:31 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:32 smithi159 ceph-mon[35522]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T07:45:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:32 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:32 smithi159 ceph-mon[35522]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:32 smithi073 ceph-mon[30850]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T07:45:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:32 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:32 smithi073 ceph-mon[30850]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:32 smithi102 ceph-mon[35514]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T07:45:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:32 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:32 smithi102 ceph-mon[35514]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:35.884 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:35 smithi073 ceph-mon[30850]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-10T07:45:36.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:35 smithi102 ceph-mon[35514]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-10T07:45:36.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:35 smithi159 ceph-mon[35522]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-10T07:45:37.912 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:37 smithi073 ceph-mon[30850]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T07:45:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:37 smithi102 ceph-mon[35514]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T07:45:38.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:37 smithi159 ceph-mon[35522]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T07:45:38.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T07:45:38.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T07:45:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:39.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T07:45:39.229 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:39.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:39 smithi073 ceph-mon[30850]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T07:45:39.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:39 smithi073 ceph-mon[30850]: Deploying daemon osd.9 on smithi073 2024-09-10T07:45:40.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:39 smithi102 ceph-mon[35514]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T07:45:40.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:39 smithi102 ceph-mon[35514]: Deploying daemon osd.9 on smithi073 2024-09-10T07:45:40.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:39 smithi159 ceph-mon[35522]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T07:45:40.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:39 smithi159 ceph-mon[35522]: Deploying daemon osd.9 on smithi073 2024-09-10T07:45:41.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:41 smithi073 ceph-mon[30850]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T07:45:42.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:41 smithi102 ceph-mon[35514]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T07:45:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:41 smithi159 ceph-mon[35522]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T07:45:43.799 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:43 smithi073 ceph-mon[30850]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T07:45:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:43 smithi102 ceph-mon[35514]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T07:45:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:43 smithi159 ceph-mon[35522]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T07:45:44.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:44.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:44.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:44 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:45.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:44 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:45.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:44 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:45.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:44 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:45.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:44 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:45.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:44 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:45.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:44 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:45.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:45 smithi073 ceph-mon[30850]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:45:46.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:45 smithi159 ceph-mon[35522]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:45:46.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:45 smithi102 ceph-mon[35514]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:45:47.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.898+0000 7fb4f7fff640 1 -- 172.21.15.73:0/3158754728 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb510062630 con 0x7fb4f80a2b80 2024-09-10T07:45:47.898 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 9 on host 'smithi073' 2024-09-10T07:45:47.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb4f80a2b80 msgr2=0x7fb4f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb4f80a2b80 0x7fb4f80a5040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5000058c0 tx=0x7fb500005ec0 comp rx=0 tx=0).stop 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510107960 msgr2=0x7fb510100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510107960 0x7fb510100bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb50800cce0 tx=0x7fb50800a620 comp rx=0 tx=0).stop 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 shutdown_connections 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb4f80a2b80 0x7fb4f80a5040 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb510107960 0x7fb510100bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb510105030 0x7fb5101006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 --2- 172.21.15.73:0/3158754728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb510102700 0x7fb510102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 >> 172.21.15.73:0/3158754728 conn(0x7fb5100fc280 msgr2=0x7fb510103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 shutdown_connections 2024-09-10T07:45:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:45:47.902+0000 7fb51560d640 1 -- 172.21.15.73:0/3158754728 wait complete. 2024-09-10T07:45:47.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:47 smithi073 ceph-mon[30850]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:47.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:47.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:47.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:47.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:47.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:47 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:47 smithi102 ceph-mon[35514]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:47 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:48.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:47 smithi159 ceph-mon[35522]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:48.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:48.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:48.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:48.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:48.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:47 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:48.654 DEBUG:teuthology.orchestra.run.smithi073:osd.9> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T07:45:48.656 INFO:tasks.cephadm:Deploying osd.10 on smithi102 with /dev/vg_nvme/lv_1... 2024-09-10T07:45:48.657 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T07:45:48.917 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:45:48.951 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:48.952 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:48.952 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:48 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:49.038 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:49.038 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:49.038 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:48 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:49.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:45:49.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:49.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:48 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:49.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:49 smithi073 ceph-mon[30850]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:50.020 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:49 smithi102 ceph-mon[35514]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:50.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:49 smithi159 ceph-mon[35522]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:50.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:50 smithi073 ceph-mon[30850]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T07:45:50.973 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 07:45:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T07:45:50.671+0000 7fb9ffeee640 -1 osd.9 0 log_to_monitors true 2024-09-10T07:45:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:50 smithi102 ceph-mon[35514]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T07:45:51.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:50 smithi159 ceph-mon[35522]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T07:45:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-10T07:45:51.407 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_1 2024-09-10T07:45:51.667 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:45:51.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T07:45:51.727+0000 7fb9fb64e640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T07:45:51.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T07:45:51.739+0000 7fb9f7c88640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:51.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:51.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:51.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:51.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:51 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:52.048 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:52.048 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T07:45:52.048 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T07:45:52.048 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:52.049 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:51 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:52.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 -- 172.21.15.102:0/1855140480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 msgr2=0x7f2268103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 --2- 172.21.15.102:0/1855140480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 0x7f2268103280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2258009900 tx=0x7f225802a410 comp rx=0 tx=0).stop 2024-09-10T07:45:52.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 -- 172.21.15.102:0/1855140480 shutdown_connections 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 --2- 172.21.15.102:0/1855140480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22681037c0 0x7f226810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 --2- 172.21.15.102:0/1855140480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 0x7f2268103280 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 --2- 172.21.15.102:0/1855140480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2268101c00 0x7f2268102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 -- 172.21.15.102:0/1855140480 >> 172.21.15.102:0/1855140480 conn(0x7f22680fd390 msgr2=0x7f22680ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 -- 172.21.15.102:0/1855140480 shutdown_connections 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 -- 172.21.15.102:0/1855140480 wait complete. 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 Processor -- start 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 -- start start 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2268101c00 0x7f2268075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.134+0000 7f226f29d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 0x7f22680745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226f29d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22681037c0 0x7f2268074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226f29d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f226810d8e0 con 0x7f2268101c00 2024-09-10T07:45:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226f29d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f226810d760 con 0x7f2268102e00 2024-09-10T07:45:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226f29d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f226810da60 con 0x7f22681037c0 2024-09-10T07:45:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226c838640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 0x7f22680745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226c838640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 0x7f22680745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48436/0 (socket says 172.21.15.102:48436) 2024-09-10T07:45:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226c838640 1 -- 172.21.15.102:0/3856429770 learned_addr learned my addr 172.21.15.102:0/3856429770 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-10T07:45:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226d039640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2268101c00 0x7f2268075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226d83a640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22681037c0 0x7f2268074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226c838640 1 -- 172.21.15.102:0/3856429770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22681037c0 msgr2=0x7f2268074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226c838640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22681037c0 0x7f2268074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226c838640 1 -- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2268101c00 msgr2=0x7f2268075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226c838640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2268101c00 0x7f2268075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226c838640 1 -- 172.21.15.102:0/3856429770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22680753e0 con 0x7f2268102e00 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226c838640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 0x7f22680745e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2258009230 tx=0x7f2258004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f225e7fc640 1 -- 172.21.15.102:0/3856429770 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225803f030 con 0x7f2268102e00 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22681a2090 con 0x7f2268102e00 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f225e7fc640 1 -- 172.21.15.102:0/3856429770 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2258003ce0 con 0x7f2268102e00 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f225e7fc640 1 -- 172.21.15.102:0/3856429770 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258035070 con 0x7f2268102e00 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.135+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22681a2590 con 0x7f2268102e00 2024-09-10T07:45:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.137+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2268109050 con 0x7f2268102e00 2024-09-10T07:45:52.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.138+0000 7f225e7fc640 1 -- 172.21.15.102:0/3856429770 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2258042030 con 0x7f2268102e00 2024-09-10T07:45:52.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.139+0000 7f225e7fc640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f22540a2b80 0x7f22540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.139+0000 7f226d039640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f22540a2b80 0x7f22540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.139+0000 7f225e7fc640 1 -- 172.21.15.102:0/3856429770 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7f22580ef280 con 0x7f2268102e00 2024-09-10T07:45:52.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.139+0000 7f226d039640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f22540a2b80 0x7f22540a5040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2264005d00 tx=0x7f2264005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:52.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.143+0000 7f225e7fc640 1 -- 172.21.15.102:0/3856429770 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f22580bca60 con 0x7f2268102e00 2024-09-10T07:45:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T07:45:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T07:45:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-09-10T07:45:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:52.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:52.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:52.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:45:52.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:52.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:52.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:51 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:45:52.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:45:52.319+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2268062630 con 0x7f22540a2b80 2024-09-10T07:45:53.000 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi073 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi073 to 4272M 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:53.001 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi073 2024-09-10T07:45:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi073 to 4272M 2024-09-10T07:45:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:45:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T07:45:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:53.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:53.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:53.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:45:53.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:45:53.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:53.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi073 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi073 to 4272M 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: from='osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:45:53.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:54.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:53 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:45:54.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:53 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:45:54.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:53 smithi102 ceph-mon[35514]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:45:54.072 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:53 smithi102 ceph-mon[35514]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:54.072 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:53 smithi102 ceph-mon[35514]: osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] boot 2024-09-10T07:45:54.072 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:53 smithi102 ceph-mon[35514]: osdmap e62: 10 total, 10 up, 10 in 2024-09-10T07:45:54.072 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:53 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:53 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:45:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:53 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:45:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:53 smithi159 ceph-mon[35522]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:45:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:53 smithi159 ceph-mon[35522]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:53 smithi159 ceph-mon[35522]: osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] boot 2024-09-10T07:45:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:53 smithi159 ceph-mon[35522]: osdmap e62: 10 total, 10 up, 10 in 2024-09-10T07:45:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:53 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:53 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:45:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:53 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:45:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:53 smithi073 ceph-mon[30850]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:45:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:53 smithi073 ceph-mon[30850]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T07:45:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:53 smithi073 ceph-mon[30850]: osd.9 [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] boot 2024-09-10T07:45:54.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:53 smithi073 ceph-mon[30850]: osdmap e62: 10 total, 10 up, 10 in 2024-09-10T07:45:54.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:53 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:45:55.020 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:54 smithi102 ceph-mon[35514]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T07:45:55.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:54 smithi159 ceph-mon[35522]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T07:45:55.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:54 smithi073 ceph-mon[30850]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T07:45:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:55 smithi102 ceph-mon[35514]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:45:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:55 smithi102 ceph-mon[35514]: from='client.? 172.21.15.102:0/3326439175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2"}]: dispatch 2024-09-10T07:45:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:55 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2"}]: dispatch 2024-09-10T07:45:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:55 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2"}]': finished 2024-09-10T07:45:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:55 smithi102 ceph-mon[35514]: osdmap e64: 11 total, 10 up, 11 in 2024-09-10T07:45:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:55 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:45:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:55 smithi102 ceph-mon[35514]: from='client.? 172.21.15.102:0/1174023351' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:45:56.160 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:55 smithi159 ceph-mon[35522]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:45:56.160 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:55 smithi159 ceph-mon[35522]: from='client.? 172.21.15.102:0/3326439175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2"}]: dispatch 2024-09-10T07:45:56.160 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:55 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2"}]: dispatch 2024-09-10T07:45:56.161 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:55 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2"}]': finished 2024-09-10T07:45:56.161 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:55 smithi159 ceph-mon[35522]: osdmap e64: 11 total, 10 up, 11 in 2024-09-10T07:45:56.161 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:55 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:45:56.161 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:55 smithi159 ceph-mon[35522]: from='client.? 172.21.15.102:0/1174023351' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:45:56.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:55 smithi073 ceph-mon[30850]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:45:56.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:55 smithi073 ceph-mon[30850]: from='client.? 172.21.15.102:0/3326439175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2"}]: dispatch 2024-09-10T07:45:56.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:55 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2"}]: dispatch 2024-09-10T07:45:56.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:55 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2"}]': finished 2024-09-10T07:45:56.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:55 smithi073 ceph-mon[30850]: osdmap e64: 11 total, 10 up, 11 in 2024-09-10T07:45:56.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:55 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:45:56.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:55 smithi073 ceph-mon[30850]: from='client.? 172.21.15.102:0/1174023351' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:45:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:57 smithi102 ceph-mon[35514]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:45:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:57 smithi159 ceph-mon[35522]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:45:58.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:57 smithi073 ceph-mon[30850]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:45:59.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:45:59 smithi102 ceph-mon[35514]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:45:59 smithi159 ceph-mon[35522]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:00.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:45:59 smithi073 ceph-mon[30850]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:01.970 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:01 smithi102 ceph-mon[35514]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:01 smithi159 ceph-mon[35522]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:02.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:01 smithi073 ceph-mon[30850]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:04.057 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:03 smithi102 ceph-mon[35514]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:04.057 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T07:46:04.057 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:04.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:03 smithi159 ceph-mon[35522]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:04.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T07:46:04.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:03 smithi073 ceph-mon[30850]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T07:46:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:05.099 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:04 smithi102 ceph-mon[35514]: Deploying daemon osd.10 on smithi102 2024-09-10T07:46:05.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:04 smithi159 ceph-mon[35522]: Deploying daemon osd.10 on smithi102 2024-09-10T07:46:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:04 smithi073 ceph-mon[30850]: Deploying daemon osd.10 on smithi102 2024-09-10T07:46:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:05 smithi102 ceph-mon[35514]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:06.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:05 smithi159 ceph-mon[35522]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:05 smithi073 ceph-mon[30850]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:08.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:07 smithi102 ceph-mon[35514]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:08.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:07 smithi159 ceph-mon[35522]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:08.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:07 smithi073 ceph-mon[30850]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:10.109 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:09 smithi102 ceph-mon[35514]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:10.109 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:10.109 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:10.109 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:09 smithi159 ceph-mon[35522]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:10.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:09 smithi073 ceph-mon[30850]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:10.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:10.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:10.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:12.060 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:11 smithi102 ceph-mon[35514]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:11 smithi159 ceph-mon[35522]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:12.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:11 smithi073 ceph-mon[30850]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:12.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.962+0000 7f225e7fc640 1 -- 172.21.15.102:0/3856429770 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2268062630 con 0x7f22540a2b80 2024-09-10T07:46:12.963 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 10 on host 'smithi102' 2024-09-10T07:46:12.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.964+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f22540a2b80 msgr2=0x7f22540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:12.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.964+0000 7f226f29d640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f22540a2b80 0x7f22540a5040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2264005d00 tx=0x7f2264005c50 comp rx=0 tx=0).stop 2024-09-10T07:46:12.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.964+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 msgr2=0x7f22680745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:12.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.964+0000 7f226f29d640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 0x7f22680745e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2258009230 tx=0x7f2258004360 comp rx=0 tx=0).stop 2024-09-10T07:46:12.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.964+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 shutdown_connections 2024-09-10T07:46:12.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.965+0000 7f226f29d640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f22540a2b80 0x7f22540a5040 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:12.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.965+0000 7f226f29d640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22681037c0 0x7f2268074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:12.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.965+0000 7f226f29d640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2268102e00 0x7f22680745e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:12.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.965+0000 7f226f29d640 1 --2- 172.21.15.102:0/3856429770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2268101c00 0x7f2268075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:12.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.965+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 >> 172.21.15.102:0/3856429770 conn(0x7f22680fd390 msgr2=0x7f2268106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:12.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.965+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 shutdown_connections 2024-09-10T07:46:12.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-10T07:46:12.965+0000 7f226f29d640 1 -- 172.21.15.102:0/3856429770 wait complete. 2024-09-10T07:46:13.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:13.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:13.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:13 smithi102 ceph-mon[35514]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:13.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:13.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:13 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.637 DEBUG:teuthology.orchestra.run.smithi102:osd.10> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T07:46:13.639 INFO:tasks.cephadm:Deploying osd.11 on smithi159 with /dev/vg_nvme/lv_1... 2024-09-10T07:46:13.640 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T07:46:13.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:13.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:13.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:13 smithi159 ceph-mon[35522]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:13.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:13.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:13 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:13 smithi073 ceph-mon[30850]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:13 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:13.894 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:46:15.764 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:15 smithi102 ceph-mon[35514]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:15.764 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:15 smithi102 ceph-mon[35514]: from='osd.10 [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T07:46:15.764 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:15 smithi102 ceph-mon[35514]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T07:46:15.764 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 07:46:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T07:46:15.513+0000 7f7f76760640 -1 osd.10 0 log_to_monitors true 2024-09-10T07:46:15.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:15 smithi159 ceph-mon[35522]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:15.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:15 smithi159 ceph-mon[35522]: from='osd.10 [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T07:46:15.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:15 smithi159 ceph-mon[35522]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T07:46:15.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:15 smithi073 ceph-mon[30850]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:15.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:15 smithi073 ceph-mon[30850]: from='osd.10 [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T07:46:15.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:15 smithi073 ceph-mon[30850]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T07:46:16.565 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T07:46:16.592 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_1 2024-09-10T07:46:16.739 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T07:46:16.739 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='osd.10 [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:16.740 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:16.741 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:46:16.741 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:16 smithi159 ceph-mon[35522]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T07:46:16.889 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:46:16.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='osd.10 [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:16.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:16.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:46:16.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:16 smithi073 ceph-mon[30850]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T07:46:17.126 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T07:46:16.706+0000 7f7f71ec0640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T07:46:17.126 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T07:46:16.720+0000 7f7f6e4fa640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:46:17.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T07:46:17.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='osd.10 [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:46:17.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T07:46:17.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:17.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-10T07:46:17.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:16 smithi102 ceph-mon[35514]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T07:46:17.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.326+0000 7f3926287640 1 -- 172.21.15.159:0/2182342283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920104f90 msgr2=0x7f3920107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:17.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.326+0000 7f3926287640 1 --2- 172.21.15.159:0/2182342283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920104f90 0x7f3920107380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3914009900 tx=0x7f391402a3f0 comp rx=0 tx=0).stop 2024-09-10T07:46:17.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.326+0000 7f3926287640 1 -- 172.21.15.159:0/2182342283 shutdown_connections 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.326+0000 7f3926287640 1 --2- 172.21.15.159:0/2182342283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39201078c0 0x7f3920109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.326+0000 7f3926287640 1 --2- 172.21.15.159:0/2182342283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920104f90 0x7f3920107380 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.326+0000 7f3926287640 1 --2- 172.21.15.159:0/2182342283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3920102660 0x7f3920104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.326+0000 7f3926287640 1 -- 172.21.15.159:0/2182342283 >> 172.21.15.159:0/2182342283 conn(0x7f39200fc280 msgr2=0x7f39200fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.326+0000 7f3926287640 1 -- 172.21.15.159:0/2182342283 shutdown_connections 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.326+0000 7f3926287640 1 -- 172.21.15.159:0/2182342283 wait complete. 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f3926287640 1 Processor -- start 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f3926287640 1 -- start start 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f3926287640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920102660 0x7f3920101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f3926287640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3920104f90 0x7f3920100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f3926287640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39201078c0 0x7f3920100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:17.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f3926287640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f392010d840 con 0x7f3920104f90 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f3926287640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f392010d6c0 con 0x7f39201078c0 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f3926287640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f392010d9c0 con 0x7f3920102660 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f391ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920102660 0x7f3920101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.327+0000 7f391ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920102660 0x7f3920101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44838/0 (socket says 172.21.15.159:44838) 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391ffff640 1 -- 172.21.15.159:0/1233516421 learned_addr learned my addr 172.21.15.159:0/1233516421 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391f7fe640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3920104f90 0x7f3920100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f3924824640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39201078c0 0x7f3920100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391ffff640 1 -- 172.21.15.159:0/1233516421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39201078c0 msgr2=0x7f3920100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391ffff640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39201078c0 0x7f3920100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391ffff640 1 -- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3920104f90 msgr2=0x7f3920100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391ffff640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3920104f90 0x7f3920100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391ffff640 1 -- 172.21.15.159:0/1233516421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3920101410 con 0x7f3920102660 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391ffff640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920102660 0x7f3920101fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f391000c920 tx=0x7f391000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:17.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391d7fa640 1 -- 172.21.15.159:0/1233516421 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910007c70 con 0x7f3920102660 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39201a1fd0 con 0x7f3920102660 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391d7fa640 1 -- 172.21.15.159:0/1233516421 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3910007e10 con 0x7f3920102660 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f391d7fa640 1 -- 172.21.15.159:0/1233516421 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910018890 con 0x7f3920102660 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.328+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39201a2420 con 0x7f3920102660 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.329+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39200fdd70 con 0x7f3920102660 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.330+0000 7f391d7fa640 1 -- 172.21.15.159:0/1233516421 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3910018a50 con 0x7f3920102660 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.331+0000 7f391d7fa640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f39080a2b80 0x7f39080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.331+0000 7f391d7fa640 1 -- 172.21.15.159:0/1233516421 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6414+0+0 (secure 0 0 0) 0x7f39100ce990 con 0x7f3920102660 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.331+0000 7f391f7fe640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f39080a2b80 0x7f39080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.332+0000 7f391f7fe640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f39080a2b80 0x7f39080a5040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3914005ab0 tx=0x7f3914000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:17.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.335+0000 7f391d7fa640 1 -- 172.21.15.159:0/1233516421 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3910014030 con 0x7f3920102660 2024-09-10T07:46:17.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:17.516+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3920062630 con 0x7f39080a2b80 2024-09-10T07:46:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:17 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi102 2024-09-10T07:46:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:17 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-10T07:46:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:17 smithi073 ceph-mon[30850]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:46:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:46:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:17 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi102 2024-09-10T07:46:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:17 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-10T07:46:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:17 smithi159 ceph-mon[35522]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:46:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:46:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:17 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi102 2024-09-10T07:46:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:17 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-10T07:46:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:17 smithi102 ceph-mon[35514]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-10T07:46:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T07:46:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T07:46:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:18.831 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:18 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:46:18.831 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:18 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:46:18.831 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:18 smithi159 ceph-mon[35522]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:46:18.831 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:18 smithi159 ceph-mon[35522]: osd.10 [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] boot 2024-09-10T07:46:18.831 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:18 smithi159 ceph-mon[35522]: osdmap e67: 11 total, 11 up, 11 in 2024-09-10T07:46:18.831 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:18 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:18.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:18 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:46:18.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:18 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:46:18.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:18 smithi073 ceph-mon[30850]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:46:18.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:18 smithi073 ceph-mon[30850]: osd.10 [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] boot 2024-09-10T07:46:18.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:18 smithi073 ceph-mon[30850]: osdmap e67: 11 total, 11 up, 11 in 2024-09-10T07:46:18.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:18 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:18 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:46:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:18 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:46:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:18 smithi102 ceph-mon[35514]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:46:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:18 smithi102 ceph-mon[35514]: osd.10 [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] boot 2024-09-10T07:46:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:18 smithi102 ceph-mon[35514]: osdmap e67: 11 total, 11 up, 11 in 2024-09-10T07:46:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:18 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:46:19.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:19 smithi159 ceph-mon[35522]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:19.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:19 smithi159 ceph-mon[35522]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T07:46:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:19 smithi073 ceph-mon[30850]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:19.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:19 smithi073 ceph-mon[30850]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T07:46:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:19 smithi102 ceph-mon[35514]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:19 smithi102 ceph-mon[35514]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T07:46:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:20 smithi102 ceph-mon[35514]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T07:46:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:20 smithi102 ceph-mon[35514]: from='client.? 172.21.15.159:0/689701480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04"}]: dispatch 2024-09-10T07:46:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:20 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04"}]: dispatch 2024-09-10T07:46:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:20 smithi102 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04"}]': finished 2024-09-10T07:46:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:20 smithi102 ceph-mon[35514]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T07:46:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:20 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:21.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:20 smithi102 ceph-mon[35514]: from='client.? 172.21.15.159:0/2747958580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:46:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:20 smithi159 ceph-mon[35522]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T07:46:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:20 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/689701480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04"}]: dispatch 2024-09-10T07:46:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:20 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04"}]: dispatch 2024-09-10T07:46:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:20 smithi159 ceph-mon[35522]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04"}]': finished 2024-09-10T07:46:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:20 smithi159 ceph-mon[35522]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T07:46:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:20 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:21.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:20 smithi159 ceph-mon[35522]: from='client.? 172.21.15.159:0/2747958580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:46:21.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:20 smithi073 ceph-mon[30850]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T07:46:21.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:20 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/689701480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04"}]: dispatch 2024-09-10T07:46:21.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:20 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04"}]: dispatch 2024-09-10T07:46:21.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:20 smithi073 ceph-mon[30850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04"}]': finished 2024-09-10T07:46:21.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:20 smithi073 ceph-mon[30850]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T07:46:21.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:20 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:21.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:20 smithi073 ceph-mon[30850]: from='client.? 172.21.15.159:0/2747958580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T07:46:22.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:21 smithi102 ceph-mon[35514]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:22.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:21 smithi102 ceph-mon[35514]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T07:46:22.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:21 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:21 smithi159 ceph-mon[35522]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:21 smithi159 ceph-mon[35522]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T07:46:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:21 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:22.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:21 smithi073 ceph-mon[30850]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:22.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:21 smithi073 ceph-mon[30850]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T07:46:22.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:21 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:22 smithi073 ceph-mon[30850]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T07:46:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:22 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:22 smithi073 ceph-mon[30850]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:23.305 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:22 smithi102 ceph-mon[35514]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T07:46:23.305 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:22 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:23.305 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:22 smithi102 ceph-mon[35514]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:23.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:22 smithi159 ceph-mon[35522]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T07:46:23.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:22 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:23.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:22 smithi159 ceph-mon[35522]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:25.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:25 smithi159 ceph-mon[35522]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-10T07:46:25.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:25 smithi073 ceph-mon[30850]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-10T07:46:26.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:25 smithi102 ceph-mon[35514]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-10T07:46:27.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:27 smithi073 ceph-mon[30850]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T07:46:28.036 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:27 smithi159 ceph-mon[35522]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T07:46:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:27 smithi102 ceph-mon[35514]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T07:46:28.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T07:46:28.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:29.107 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T07:46:29.107 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T07:46:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:29.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:29 smithi073 ceph-mon[30850]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T07:46:29.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:29 smithi073 ceph-mon[30850]: Deploying daemon osd.11 on smithi159 2024-09-10T07:46:30.011 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:29 smithi159 ceph-mon[35522]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T07:46:30.011 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:29 smithi159 ceph-mon[35522]: Deploying daemon osd.11 on smithi159 2024-09-10T07:46:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:29 smithi102 ceph-mon[35514]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T07:46:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:29 smithi102 ceph-mon[35514]: Deploying daemon osd.11 on smithi159 2024-09-10T07:46:31.885 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:31 smithi159 ceph-mon[35522]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T07:46:31.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:31 smithi073 ceph-mon[30850]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T07:46:32.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:31 smithi102 ceph-mon[35514]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T07:46:33.991 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:33 smithi159 ceph-mon[35522]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T07:46:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:33 smithi102 ceph-mon[35514]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T07:46:34.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:33 smithi073 ceph-mon[30850]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T07:46:34.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:34.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:34.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:34 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:35.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:35.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:35.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:34 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:34 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:35.955 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:35 smithi159 ceph-mon[35522]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:46:36.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:35 smithi102 ceph-mon[35514]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:46:36.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:35 smithi073 ceph-mon[30850]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T07:46:37.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:37 smithi159 ceph-mon[35522]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:37.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:37.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:37.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:37.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:37.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:37 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:37.896 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 11 on host 'smithi159' 2024-09-10T07:46:37.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.897+0000 7f391d7fa640 1 -- 172.21.15.159:0/1233516421 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3920062630 con 0x7f39080a2b80 2024-09-10T07:46:37.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f39080a2b80 msgr2=0x7f39080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:37.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f39080a2b80 0x7f39080a5040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3914005ab0 tx=0x7f3914000bc0 comp rx=0 tx=0).stop 2024-09-10T07:46:37.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920102660 msgr2=0x7f3920101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:37.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920102660 0x7f3920101fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f391000c920 tx=0x7f391000cde0 comp rx=0 tx=0).stop 2024-09-10T07:46:37.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 shutdown_connections 2024-09-10T07:46:37.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f39080a2b80 0x7f39080a5040 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:37.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39201078c0 0x7f3920100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:37.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3920104f90 0x7f3920100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:37.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 --2- 172.21.15.159:0/1233516421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3920102660 0x7f3920101fc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:37.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.899+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 >> 172.21.15.159:0/1233516421 conn(0x7f39200fc280 msgr2=0x7f3920102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:37.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.900+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 shutdown_connections 2024-09-10T07:46:37.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:37.900+0000 7f3926287640 1 -- 172.21.15.159:0/1233516421 wait complete. 2024-09-10T07:46:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:37 smithi102 ceph-mon[35514]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:37 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:37 smithi073 ceph-mon[30850]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:38.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:37 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:38.481 DEBUG:teuthology.orchestra.run.smithi159:osd.11> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T07:46:38.484 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T07:46:38.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T07:46:38.739 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:46:38.860 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:38.860 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:38.860 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:38 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:38.988 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:38.988 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:38.988 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:38 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:38 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:39.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/3143680981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 msgr2=0x7fb9e4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:39.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/3143680981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 0x7fb9e4100f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009900 tx=0x7fb9d402a410 comp rx=0 tx=0).stop 2024-09-10T07:46:39.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/3143680981 shutdown_connections 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/3143680981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9e41026d0 0x7fb9e4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/3143680981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e4101d10 0x7fb9e4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/3143680981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 0x7fb9e4100f10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/3143680981 >> 172.21.15.73:0/3143680981 conn(0x7fb9e40fc2a0 msgr2=0x7fb9e40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/3143680981 shutdown_connections 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/3143680981 wait complete. 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 Processor -- start 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.244+0000 7fb9ea8d0640 1 -- start start 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9ea8d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 0x7fb9e4197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9ea8d0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e4101d10 0x7fb9e4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:39.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9ea8d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9e41026d0 0x7fb9e419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9ea8d0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e410c790 con 0x7fb9e4100b10 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9ea8d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e410c610 con 0x7fb9e41026d0 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9ea8d0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e410c910 con 0x7fb9e4101d10 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 0x7fb9e4197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 0x7fb9e4197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59656/0 (socket says 172.21.15.73:59656) 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e3fff640 1 -- 172.21.15.73:0/414084880 learned_addr learned my addr 172.21.15.73:0/414084880 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e37fe640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e4101d10 0x7fb9e4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e8e6d640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9e41026d0 0x7fb9e419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e3fff640 1 -- 172.21.15.73:0/414084880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e4101d10 msgr2=0x7fb9e4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e3fff640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e4101d10 0x7fb9e4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e3fff640 1 -- 172.21.15.73:0/414084880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9e41026d0 msgr2=0x7fb9e419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e3fff640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9e41026d0 0x7fb9e419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:39.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e3fff640 1 -- 172.21.15.73:0/414084880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e419fb30 con 0x7fb9e4100b10 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e3fff640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 0x7fb9e4197f50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4031610 tx=0x7fb9d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e17fa640 1 -- 172.21.15.73:0/414084880 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d403f030 con 0x7fb9e4100b10 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e419fdc0 con 0x7fb9e4100b10 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e17fa640 1 -- 172.21.15.73:0/414084880 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d4003ad0 con 0x7fb9e4100b10 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9e17fa640 1 -- 172.21.15.73:0/414084880 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4035070 con 0x7fb9e4100b10 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.245+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e41a0210 con 0x7fb9e4100b10 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.246+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e41a0440 con 0x7fb9e4100b10 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.247+0000 7fb9e17fa640 1 -- 172.21.15.73:0/414084880 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb9d4042030 con 0x7fb9e4100b10 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.248+0000 7fb9e17fa640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9cc0a2bb0 0x7fb9cc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.248+0000 7fb9e37fe640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9cc0a2bb0 0x7fb9cc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.248+0000 7fb9e17fa640 1 -- 172.21.15.73:0/414084880 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7fb9d40ef170 con 0x7fb9e4100b10 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.249+0000 7fb9e37fe640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9cc0a2bb0 0x7fb9cc0a5070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4199420 tx=0x7fb9d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:39.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.252+0000 7fb9e17fa640 1 -- 172.21.15.73:0/414084880 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9d40bc6b0 con 0x7fb9e4100b10 2024-09-10T07:46:39.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.420+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb9e41a0930 con 0x7fb9e4100b10 2024-09-10T07:46:39.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.420+0000 7fb9e17fa640 1 -- 172.21.15.73:0/414084880 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fb9d40bbfb0 con 0x7fb9e4100b10 2024-09-10T07:46:39.420 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9cc0a2bb0 msgr2=0x7fb9cc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9cc0a2bb0 0x7fb9cc0a5070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4199420 tx=0x7fb9d8005f90 comp rx=0 tx=0).stop 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 msgr2=0x7fb9e4197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 0x7fb9e4197f50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4031610 tx=0x7fb9d4004270 comp rx=0 tx=0).stop 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 shutdown_connections 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb9cc0a2bb0 0x7fb9cc0a5070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9e41026d0 0x7fb9e419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e4101d10 0x7fb9e4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 --2- 172.21.15.73:0/414084880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9e4100b10 0x7fb9e4197f50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 >> 172.21.15.73:0/414084880 conn(0x7fb9e40fc2a0 msgr2=0x7fb9e40fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 shutdown_connections 2024-09-10T07:46:39.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:39.423+0000 7fb9ea8d0640 1 -- 172.21.15.73:0/414084880 wait complete. 2024-09-10T07:46:39.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:39 smithi073 ceph-mon[30850]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:39.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:39 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/414084880' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T07:46:39.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:39 smithi159 ceph-mon[35522]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:39.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:39 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/414084880' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T07:46:40.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:39 smithi102 ceph-mon[35514]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:40.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:39 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/414084880' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T07:46:40.185 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1725954377,"num_in_osds":12,"osd_in_since":1725954379,"num_remapped_pgs":0} 2024-09-10T07:46:40.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:40 smithi159 ceph-mon[35522]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T07:46:40.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 07:46:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T07:46:40.548+0000 7fa2d9d03640 -1 osd.11 0 log_to_monitors true 2024-09-10T07:46:40.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:40 smithi073 ceph-mon[30850]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T07:46:41.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:40 smithi102 ceph-mon[35514]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T07:46:41.187 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T07:46:41.437 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:46:41.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:41.829 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T07:46:41.829 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T07:46:41.829 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:46:41.829 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:41.829 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:41.829 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:41.829 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:41.829 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:41.829 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:41.830 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:41.830 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:41.830 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:41.830 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:41.830 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:41 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 -- 172.21.15.73:0/1017412928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728101cd0 msgr2=0x7f1728102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 --2- 172.21.15.73:0/1017412928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728101cd0 0x7f1728102150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1718009900 tx=0x7f171802a410 comp rx=0 tx=0).stop 2024-09-10T07:46:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 -- 172.21.15.73:0/1017412928 shutdown_connections 2024-09-10T07:46:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 --2- 172.21.15.73:0/1017412928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1728102690 0x7f1728108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 --2- 172.21.15.73:0/1017412928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728101cd0 0x7f1728102150 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 --2- 172.21.15.73:0/1017412928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1728100ad0 0x7f1728100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 -- 172.21.15.73:0/1017412928 >> 172.21.15.73:0/1017412928 conn(0x7f17280fc280 msgr2=0x7f17280fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:41.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 -- 172.21.15.73:0/1017412928 shutdown_connections 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 -- 172.21.15.73:0/1017412928 wait complete. 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.910+0000 7f1730225640 1 Processor -- start 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f1730225640 1 -- start start 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f1730225640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1728100ad0 0x7f1728196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f1730225640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1728101cd0 0x7f17281973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f1730225640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728102690 0x7f172819e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f1730225640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f172810c7d0 con 0x7f1728102690 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f1730225640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f172810c650 con 0x7f1728101cd0 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f1730225640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f172810c950 con 0x7f1728100ad0 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172e7c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728102690 0x7f172819e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172e7c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728102690 0x7f172819e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51758/0 (socket says 172.21.15.73:51758) 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172e7c2640 1 -- 172.21.15.73:0/3625720413 learned_addr learned my addr 172.21.15.73:0/3625720413 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:46:41.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172dfc1640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1728100ad0 0x7f1728196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172e7c2640 1 -- 172.21.15.73:0/3625720413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1728100ad0 msgr2=0x7f1728196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172e7c2640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1728100ad0 0x7f1728196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172e7c2640 1 -- 172.21.15.73:0/3625720413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1728101cd0 msgr2=0x7f17281973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172e7c2640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1728101cd0 0x7f17281973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172e7c2640 1 -- 172.21.15.73:0/3625720413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172819ead0 con 0x7f1728102690 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f172e7c2640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728102690 0x7f172819e460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1720009fd0 tx=0x7f17200071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f171effd640 1 -- 172.21.15.73:0/3625720413 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17200079f0 con 0x7f1728102690 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f171effd640 1 -- 172.21.15.73:0/3625720413 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1720003e50 con 0x7f1728102690 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1728069fd0 con 0x7f1728102690 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.911+0000 7f171effd640 1 -- 172.21.15.73:0/3625720413 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17200047d0 con 0x7f1728102690 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.912+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172806a510 con 0x7f1728102690 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.913+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1728100eb0 con 0x7f1728102690 2024-09-10T07:46:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.914+0000 7f171effd640 1 -- 172.21.15.73:0/3625720413 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1720003970 con 0x7f1728102690 2024-09-10T07:46:41.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.914+0000 7f171effd640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f17140a2c30 0x7f17140a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:41.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.915+0000 7f172dfc1640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f17140a2c30 0x7f17140a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:41.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.915+0000 7f171effd640 1 -- 172.21.15.73:0/3625720413 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7f17200d0640 con 0x7f1728102690 2024-09-10T07:46:41.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.915+0000 7f172dfc1640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f17140a2c30 0x7f17140a50f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1728101b30 tx=0x7f1724009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:41.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:41.918+0000 7f171effd640 1 -- 172.21.15.73:0/3625720413 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f172009db60 con 0x7f1728102690 2024-09-10T07:46:42.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.086+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1728107b80 con 0x7f1728102690 2024-09-10T07:46:42.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.087+0000 7f171effd640 1 -- 172.21.15.73:0/3625720413 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f1728107b80 con 0x7f1728102690 2024-09-10T07:46:42.086 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f17140a2c30 msgr2=0x7f17140a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f17140a2c30 0x7f17140a50f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1728101b30 tx=0x7f1724009110 comp rx=0 tx=0).stop 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728102690 msgr2=0x7f172819e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728102690 0x7f172819e460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1720009fd0 tx=0x7f17200071c0 comp rx=0 tx=0).stop 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 shutdown_connections 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f17140a2c30 0x7f17140a50f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1728102690 0x7f172819e460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1728101cd0 0x7f17281973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 --2- 172.21.15.73:0/3625720413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1728100ad0 0x7f1728196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 >> 172.21.15.73:0/3625720413 conn(0x7f17280fc280 msgr2=0x7f1728105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 shutdown_connections 2024-09-10T07:46:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:42.089+0000 7f1730225640 1 -- 172.21.15.73:0/3625720413 wait complete. 2024-09-10T07:46:42.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:42.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T07:46:42.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T07:46:42.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:46:42.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:42.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:42.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:42.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:42.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:42.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:42.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:42.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:42.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:42.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:42.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:41 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T07:46:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T07:46:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-10T07:46:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:42.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:42.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:42.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:42.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:46:42.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:42.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:42.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:42.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:41 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:42.770 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1725954377,"num_in_osds":12,"osd_in_since":1725954379,"num_remapped_pgs":0} 2024-09-10T07:46:42.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-mon[35522]: Detected new or changed devices on smithi159 2024-09-10T07:46:42.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-10T07:46:42.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-mon[35522]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:46:42.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-mon[35522]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T07:46:42.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:42.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:42.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3625720413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T07:46:42.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-mon[35522]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' 2024-09-10T07:46:42.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T07:46:42.520+0000 7fa2d5463640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T07:46:42.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 07:46:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T07:46:42.534+0000 7fa2cda95640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:46:43.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:42 smithi102 ceph-mon[35514]: Detected new or changed devices on smithi159 2024-09-10T07:46:43.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:42 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-10T07:46:43.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:42 smithi102 ceph-mon[35514]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:46:43.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:42 smithi102 ceph-mon[35514]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T07:46:43.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:42 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:43.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:42 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:43.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:42 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3625720413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T07:46:43.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:42 smithi102 ceph-mon[35514]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' 2024-09-10T07:46:43.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:42 smithi073 ceph-mon[30850]: Detected new or changed devices on smithi159 2024-09-10T07:46:43.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:42 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-10T07:46:43.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:42 smithi073 ceph-mon[30850]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-10T07:46:43.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:42 smithi073 ceph-mon[30850]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T07:46:43.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:42 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:43.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:42 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:43.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:42 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3625720413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T07:46:43.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:42 smithi073 ceph-mon[30850]: from='osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392]' entity='osd.11' 2024-09-10T07:46:43.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T07:46:44.017 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:46:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:43 smithi102 ceph-mon[35514]: purged_snaps scrub starts 2024-09-10T07:46:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:43 smithi102 ceph-mon[35514]: purged_snaps scrub ok 2024-09-10T07:46:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:43 smithi102 ceph-mon[35514]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:43 smithi102 ceph-mon[35514]: osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] boot 2024-09-10T07:46:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:43 smithi102 ceph-mon[35514]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T07:46:44.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:43 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:44.137 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:43 smithi073 ceph-mon[30850]: purged_snaps scrub starts 2024-09-10T07:46:44.137 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:43 smithi073 ceph-mon[30850]: purged_snaps scrub ok 2024-09-10T07:46:44.137 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:43 smithi073 ceph-mon[30850]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:44.137 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:44.137 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:43 smithi073 ceph-mon[30850]: osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] boot 2024-09-10T07:46:44.137 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:43 smithi073 ceph-mon[30850]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T07:46:44.137 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:43 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:43 smithi159 ceph-mon[35522]: purged_snaps scrub starts 2024-09-10T07:46:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:43 smithi159 ceph-mon[35522]: purged_snaps scrub ok 2024-09-10T07:46:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:43 smithi159 ceph-mon[35522]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-10T07:46:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:43 smithi159 ceph-mon[35522]: osd.11 [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] boot 2024-09-10T07:46:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:43 smithi159 ceph-mon[35522]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T07:46:44.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:43 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:46:44.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.457+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/4114062772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f441026d0 msgr2=0x7f5f44108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.457+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/4114062772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f441026d0 0x7f5f44108f60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009ca0 tx=0x7f5f3c02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.457+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/4114062772 shutdown_connections 2024-09-10T07:46:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.457+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/4114062772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f441026d0 0x7f5f44108f60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.457+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/4114062772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f44101d10 0x7f5f44102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.457+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/4114062772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44100b10 0x7f5f44100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.457+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/4114062772 >> 172.21.15.73:0/4114062772 conn(0x7f5f440fc2a0 msgr2=0x7f5f440fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.457+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/4114062772 shutdown_connections 2024-09-10T07:46:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.457+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/4114062772 wait complete. 2024-09-10T07:46:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4bbaf640 1 Processor -- start 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4bbaf640 1 -- start start 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4bbaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44100b10 0x7f5f44197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4bbaf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f44101d10 0x7f5f441983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4bbaf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f441026d0 0x7f5f4419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4bbaf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410c7e0 con 0x7f5f44101d10 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4bbaf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410c660 con 0x7f5f44100b10 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4bbaf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410c960 con 0x7f5f441026d0 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4914a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f44101d10 0x7f5f441983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4914a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f44101d10 0x7f5f441983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51774/0 (socket says 172.21.15.73:51774) 2024-09-10T07:46:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4914a640 1 -- 172.21.15.73:0/72094658 learned_addr learned my addr 172.21.15.73:0/72094658 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4994b640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44100b10 0x7f5f44197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4914a640 1 -- 172.21.15.73:0/72094658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f441026d0 msgr2=0x7f5f4419f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4914a640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f441026d0 0x7f5f4419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4914a640 1 -- 172.21.15.73:0/72094658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44100b10 msgr2=0x7f5f44197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4914a640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44100b10 0x7f5f44197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.458+0000 7f5f4914a640 1 -- 172.21.15.73:0/72094658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4419fae0 con 0x7f5f44101d10 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.459+0000 7f5f4914a640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f44101d10 0x7f5f441983f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400d770 tx=0x7f5f3400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.459+0000 7f5f3affd640 1 -- 172.21.15.73:0/72094658 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34017070 con 0x7f5f44101d10 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.459+0000 7f5f3affd640 1 -- 172.21.15.73:0/72094658 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f34005500 con 0x7f5f44101d10 2024-09-10T07:46:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.459+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4419fdd0 con 0x7f5f44101d10 2024-09-10T07:46:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.459+0000 7f5f3affd640 1 -- 172.21.15.73:0/72094658 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34004e00 con 0x7f5f44101d10 2024-09-10T07:46:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.459+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f441a0230 con 0x7f5f44101d10 2024-09-10T07:46:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.460+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f441a0490 con 0x7f5f44101d10 2024-09-10T07:46:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.461+0000 7f5f3affd640 1 -- 172.21.15.73:0/72094658 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5f34004fa0 con 0x7f5f44101d10 2024-09-10T07:46:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.462+0000 7f5f3affd640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5f300a2bb0 0x7f5f300a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.462+0000 7f5f4994b640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5f300a2bb0 0x7f5f300a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.462+0000 7f5f3affd640 1 -- 172.21.15.73:0/72094658 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5f340ce640 con 0x7f5f44101d10 2024-09-10T07:46:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.462+0000 7f5f4994b640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5f300a2bb0 0x7f5f300a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f40005fd0 tx=0x7f5f40005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.466+0000 7f5f3affd640 1 -- 172.21.15.73:0/72094658 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f3409ba40 con 0x7f5f44101d10 2024-09-10T07:46:44.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.637+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5f441a0820 con 0x7f5f44101d10 2024-09-10T07:46:44.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.637+0000 7f5f3affd640 1 -- 172.21.15.73:0/72094658 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f5f3409b340 con 0x7f5f44101d10 2024-09-10T07:46:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:46:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5f300a2bb0 msgr2=0x7f5f300a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5f300a2bb0 0x7f5f300a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f40005fd0 tx=0x7f5f40005850 comp rx=0 tx=0).stop 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f44101d10 msgr2=0x7f5f441983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f44101d10 0x7f5f441983f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400d770 tx=0x7f5f3400dc30 comp rx=0 tx=0).stop 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 shutdown_connections 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f5f300a2bb0 0x7f5f300a5070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f441026d0 0x7f5f4419f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f44101d10 0x7f5f441983f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 --2- 172.21.15.73:0/72094658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44100b10 0x7f5f44197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 >> 172.21.15.73:0/72094658 conn(0x7f5f440fc2a0 msgr2=0x7f5f440fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 shutdown_connections 2024-09-10T07:46:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:44.639+0000 7f5f4bbaf640 1 -- 172.21.15.73:0/72094658 wait complete. 2024-09-10T07:46:45.219 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1725954403,"num_in_osds":12,"osd_in_since":1725954379,"num_remapped_pgs":0} 2024-09-10T07:46:45.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T07:46:45.461 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:46:45.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:45 smithi073 ceph-mon[30850]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T07:46:45.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:45 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/72094658' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T07:46:45.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:45 smithi073 ceph-mon[30850]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:45.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:45 smithi102 ceph-mon[35514]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T07:46:45.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:45 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/72094658' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T07:46:45.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:45 smithi102 ceph-mon[35514]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:45.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:45 smithi159 ceph-mon[35522]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T07:46:45.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:45 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/72094658' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T07:46:45.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:45 smithi159 ceph-mon[35522]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.908+0000 7fc4f98d0640 1 -- 172.21.15.73:0/199615715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 msgr2=0x7fc4f410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.908+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/199615715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 0x7fc4f410da40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009ca0 tx=0x7fc4ec02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:46:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 -- 172.21.15.73:0/199615715 shutdown_connections 2024-09-10T07:46:45.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/199615715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 0x7fc4f410da40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/199615715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4f4101e30 0x7fc4f4105750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/199615715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f4101480 0x7fc4f4101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 -- 172.21.15.73:0/199615715 >> 172.21.15.73:0/199615715 conn(0x7fc4f4077210 msgr2=0x7fc4f40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 -- 172.21.15.73:0/199615715 shutdown_connections 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 -- 172.21.15.73:0/199615715 wait complete. 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 Processor -- start 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 -- start start 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.909+0000 7fc4f98d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4f4101480 0x7fc4f4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f98d0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f4101e30 0x7fc4f4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f98d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 0x7fc4f41a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:45.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f98d0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f4110f60 con 0x7fc4f4105e80 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f98d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f4110de0 con 0x7fc4f4101480 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f98d0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f41110e0 con 0x7fc4f4101e30 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 0x7fc4f41a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 0x7fc4f41a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51784/0 (socket says 172.21.15.73:51784) 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f37fe640 1 -- 172.21.15.73:0/1915902460 learned_addr learned my addr 172.21.15.73:0/1915902460 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f27fc640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f4101e30 0x7fc4f4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f2ffd640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4f4101480 0x7fc4f4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f37fe640 1 -- 172.21.15.73:0/1915902460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f4101e30 msgr2=0x7fc4f4199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f37fe640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f4101e30 0x7fc4f4199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:45.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f37fe640 1 -- 172.21.15.73:0/1915902460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4f4101480 msgr2=0x7fc4f4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f37fe640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4f4101480 0x7fc4f4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f37fe640 1 -- 172.21.15.73:0/1915902460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f41a4910 con 0x7fc4f4105e80 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f27fc640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f4101e30 0x7fc4f4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f37fe640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 0x7fc4f41a43d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec031a20 tx=0x7fc4ec031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f88ce640 1 -- 172.21.15.73:0/1915902460 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec003c30 con 0x7fc4f4105e80 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f41a4ae0 con 0x7fc4f4105e80 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f88ce640 1 -- 172.21.15.73:0/1915902460 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ec003dd0 con 0x7fc4f4105e80 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f88ce640 1 -- 172.21.15.73:0/1915902460 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec02fcf0 con 0x7fc4f4105e80 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.910+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f41a4f70 con 0x7fc4f4105e80 2024-09-10T07:46:45.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.911+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f4101860 con 0x7fc4f4105e80 2024-09-10T07:46:45.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.913+0000 7fc4f88ce640 1 -- 172.21.15.73:0/1915902460 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc4ec004050 con 0x7fc4f4105e80 2024-09-10T07:46:45.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.913+0000 7fc4f88ce640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:45.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.914+0000 7fc4f2ffd640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:45.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.914+0000 7fc4f88ce640 1 -- 172.21.15.73:0/1915902460 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc4ec0f01a0 con 0x7fc4f4105e80 2024-09-10T07:46:45.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.914+0000 7fc4f2ffd640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4005fd0 tx=0x7fc4e4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:45.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:45.918+0000 7fc4f88ce640 1 -- 172.21.15.73:0/1915902460 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc4ec0bd630 con 0x7fc4f4105e80 2024-09-10T07:46:46.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.084+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4f4109100 con 0x7fc4f4105e80 2024-09-10T07:46:46.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.085+0000 7fc4f88ce640 1 -- 172.21.15.73:0/1915902460 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18465 (secure 0 0 0) 0x7fc4ec02fe90 con 0x7fc4f4105e80 2024-09-10T07:46:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:46:46.085 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":76,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:46:44.532418+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:46:46.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc4dc0a2b80 msgr2=0x7fc4dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:46.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4005fd0 tx=0x7fc4e4005850 comp rx=0 tx=0).stop 2024-09-10T07:46:46.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 msgr2=0x7fc4f41a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:46.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 0x7fc4f41a43d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec031a20 tx=0x7fc4ec031a50 comp rx=0 tx=0).stop 2024-09-10T07:46:46.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 shutdown_connections 2024-09-10T07:46:46.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:46.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f4105e80 0x7fc4f41a43d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:46.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f4101e30 0x7fc4f4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:46.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 --2- 172.21.15.73:0/1915902460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4f4101480 0x7fc4f4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:46.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 >> 172.21.15.73:0/1915902460 conn(0x7fc4f4077210 msgr2=0x7fc4f41045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:46.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 shutdown_connections 2024-09-10T07:46:46.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:46.088+0000 7fc4f98d0640 1 -- 172.21.15.73:0/1915902460 wait complete. 2024-09-10T07:46:46.685 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:42:58.876964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:46:46.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T07:46:46.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:46 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1915902460' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:46:46.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:46 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1915902460' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:46:46.927 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:46:46.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:46 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1915902460' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:46:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.368+0000 7fa81a2d7640 1 -- 172.21.15.73:0/2259809183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814101de0 msgr2=0x7fa8141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.368+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/2259809183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814101de0 0x7fa8141021c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa804009900 tx=0x7fa80402a410 comp rx=0 tx=0).stop 2024-09-10T07:46:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.368+0000 7fa81a2d7640 1 -- 172.21.15.73:0/2259809183 shutdown_connections 2024-09-10T07:46:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.368+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/2259809183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa814106f10 0x7fa81410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.368+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/2259809183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa814102790 0x7fa8141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.368+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/2259809183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814101de0 0x7fa8141021c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.368+0000 7fa81a2d7640 1 -- 172.21.15.73:0/2259809183 >> 172.21.15.73:0/2259809183 conn(0x7fa8140fd8c0 msgr2=0x7fa8140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.368+0000 7fa81a2d7640 1 -- 172.21.15.73:0/2259809183 shutdown_connections 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.368+0000 7fa81a2d7640 1 -- 172.21.15.73:0/2259809183 wait complete. 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa81a2d7640 1 Processor -- start 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa81a2d7640 1 -- start start 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa81a2d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa814101de0 0x7fa8140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa81a2d7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa814102790 0x7fa814074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa81a2d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814106f10 0x7fa814074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa81a2d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa814111f30 con 0x7fa814106f10 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa81a2d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa814111db0 con 0x7fa814101de0 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa81a2d7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa8141120b0 con 0x7fa814102790 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa818874640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814106f10 0x7fa814074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.369+0000 7fa818874640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814106f10 0x7fa814074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51804/0 (socket says 172.21.15.73:51804) 2024-09-10T07:46:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa818874640 1 -- 172.21.15.73:0/3814340057 learned_addr learned my addr 172.21.15.73:0/3814340057 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa8137fe640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa814102790 0x7fa814074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa813fff640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa814101de0 0x7fa8140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa818874640 1 -- 172.21.15.73:0/3814340057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa814102790 msgr2=0x7fa814074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa818874640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa814102790 0x7fa814074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa818874640 1 -- 172.21.15.73:0/3814340057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa814101de0 msgr2=0x7fa8140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa818874640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa814101de0 0x7fa8140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa818874640 1 -- 172.21.15.73:0/3814340057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8141a6980 con 0x7fa814106f10 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa818874640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814106f10 0x7fa814074f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00eaa0 tx=0x7fa80c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa8117fa640 1 -- 172.21.15.73:0/3814340057 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00cdb0 con 0x7fa814106f10 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa8117fa640 1 -- 172.21.15.73:0/3814340057 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa80c005020 con 0x7fa814106f10 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8141a6c70 con 0x7fa814106f10 2024-09-10T07:46:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa8117fa640 1 -- 172.21.15.73:0/3814340057 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0116b0 con 0x7fa814106f10 2024-09-10T07:46:47.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.370+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8141a7160 con 0x7fa814106f10 2024-09-10T07:46:47.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.371+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8141021c0 con 0x7fa814106f10 2024-09-10T07:46:47.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.372+0000 7fa8117fa640 1 -- 172.21.15.73:0/3814340057 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa80c005560 con 0x7fa814106f10 2024-09-10T07:46:47.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.373+0000 7fa8117fa640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa8000a2b80 0x7fa8000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:47.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.373+0000 7fa813fff640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa8000a2b80 0x7fa8000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:47.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.373+0000 7fa8117fa640 1 -- 172.21.15.73:0/3814340057 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fa80c0cf140 con 0x7fa814106f10 2024-09-10T07:46:47.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.374+0000 7fa813fff640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa8000a2b80 0x7fa8000a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa804005ab0 tx=0x7fa804005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:47.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.376+0000 7fa8117fa640 1 -- 172.21.15.73:0/3814340057 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa80c016030 con 0x7fa814106f10 2024-09-10T07:46:47.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.541+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa81410a0f0 con 0x7fa814106f10 2024-09-10T07:46:47.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.543+0000 7fa8117fa640 1 -- 172.21.15.73:0/3814340057 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7fa80c09c540 con 0x7fa814106f10 2024-09-10T07:46:47.542 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-10T07:46:47.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa8000a2b80 msgr2=0x7fa8000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:47.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa8000a2b80 0x7fa8000a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa804005ab0 tx=0x7fa804005a20 comp rx=0 tx=0).stop 2024-09-10T07:46:47.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814106f10 msgr2=0x7fa814074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:47.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814106f10 0x7fa814074f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00eaa0 tx=0x7fa80c00ef60 comp rx=0 tx=0).stop 2024-09-10T07:46:47.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 shutdown_connections 2024-09-10T07:46:47.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa8000a2b80 0x7fa8000a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:47.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa814106f10 0x7fa814074f70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:47.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa814102790 0x7fa814074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:47.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 --2- 172.21.15.73:0/3814340057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa814101de0 0x7fa8140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:47.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 >> 172.21.15.73:0/3814340057 conn(0x7fa8140fd8c0 msgr2=0x7fa8140fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:47.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 shutdown_connections 2024-09-10T07:46:47.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:47.545+0000 7fa81a2d7640 1 -- 172.21.15.73:0/3814340057 wait complete. 2024-09-10T07:46:47.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:47 smithi073 ceph-mon[30850]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:47.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:47 smithi102 ceph-mon[35514]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:47.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:47 smithi159 ceph-mon[35522]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:48.144 INFO:tasks.cephadm:Adding mds.a on smithi073 2024-09-10T07:46:48.144 INFO:tasks.cephadm:Adding mds.d on smithi073 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.g on smithi073 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.j on smithi073 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.b on smithi102 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.e on smithi102 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.h on smithi102 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.k on smithi102 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.c on smithi159 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.f on smithi159 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.i on smithi159 2024-09-10T07:46:48.145 INFO:tasks.cephadm:Adding mds.l on smithi159 2024-09-10T07:46:48.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l' 2024-09-10T07:46:48.392 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:46:48.794 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:48 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3814340057' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T07:46:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:48 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3814340057' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T07:46:48.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.880+0000 7efdb8e9a640 1 -- 172.21.15.159:0/1256714826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 msgr2=0x7efdb4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:48.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.880+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/1256714826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 0x7efdb4100f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efda8009900 tx=0x7efda802a410 comp rx=0 tx=0).stop 2024-09-10T07:46:48.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.880+0000 7efdb8e9a640 1 -- 172.21.15.159:0/1256714826 shutdown_connections 2024-09-10T07:46:48.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.880+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/1256714826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdb41026d0 0x7efdb4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:48.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.880+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/1256714826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb4101d10 0x7efdb4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.880+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/1256714826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 0x7efdb4100f10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.880+0000 7efdb8e9a640 1 -- 172.21.15.159:0/1256714826 >> 172.21.15.159:0/1256714826 conn(0x7efdb40fc2a0 msgr2=0x7efdb40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.880+0000 7efdb8e9a640 1 -- 172.21.15.159:0/1256714826 shutdown_connections 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.880+0000 7efdb8e9a640 1 -- 172.21.15.159:0/1256714826 wait complete. 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.881+0000 7efdb8e9a640 1 Processor -- start 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.881+0000 7efdb8e9a640 1 -- start start 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.881+0000 7efdb8e9a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 0x7efdb406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.881+0000 7efdb8e9a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb4101d10 0x7efdb419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.881+0000 7efdb8e9a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdb41026d0 0x7efdb41a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.881+0000 7efdb8e9a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efdb410c770 con 0x7efdb4101d10 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.881+0000 7efdb8e9a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efdb410c5f0 con 0x7efdb41026d0 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.881+0000 7efdb8e9a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efdb410c8f0 con 0x7efdb4100b10 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 0x7efdb406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 0x7efdb406b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49846/0 (socket says 172.21.15.159:49846) 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb259c640 1 -- 172.21.15.159:0/3640729063 learned_addr learned my addr 172.21.15.159:0/3640729063 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb2d9d640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdb41026d0 0x7efdb41a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb1d9b640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb4101d10 0x7efdb419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb259c640 1 -- 172.21.15.159:0/3640729063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdb41026d0 msgr2=0x7efdb41a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb259c640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdb41026d0 0x7efdb41a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb259c640 1 -- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb4101d10 msgr2=0x7efdb419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb259c640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb4101d10 0x7efdb419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb259c640 1 -- 172.21.15.159:0/3640729063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb41a1d40 con 0x7efdb4100b10 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb2d9d640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdb41026d0 0x7efdb41a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb259c640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 0x7efdb406b2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efda8031610 tx=0x7efda80043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efda37fe640 1 -- 172.21.15.159:0/3640729063 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda803f030 con 0x7efdb4100b10 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb41a1f70 con 0x7efdb4100b10 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efda37fe640 1 -- 172.21.15.159:0/3640729063 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efda8003ce0 con 0x7efdb4100b10 2024-09-10T07:46:48.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efda37fe640 1 -- 172.21.15.159:0/3640729063 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8035070 con 0x7efdb4100b10 2024-09-10T07:46:48.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.882+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb41a23c0 con 0x7efdb4100b10 2024-09-10T07:46:48.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.883+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb4107f60 con 0x7efdb4100b10 2024-09-10T07:46:48.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.885+0000 7efda37fe640 1 -- 172.21.15.159:0/3640729063 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efda8042030 con 0x7efdb4100b10 2024-09-10T07:46:48.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.885+0000 7efda37fe640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efd9c0a2bb0 0x7efd9c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:48.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.885+0000 7efda37fe640 1 -- 172.21.15.159:0/3640729063 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7efda80ef3e0 con 0x7efdb4100b10 2024-09-10T07:46:48.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.885+0000 7efdb1d9b640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efd9c0a2bb0 0x7efd9c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:48.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.886+0000 7efdb1d9b640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efd9c0a2bb0 0x7efd9c0a5070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efda4005fd0 tx=0x7efda4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:48.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:48.889+0000 7efda37fe640 1 -- 172.21.15.159:0/3640729063 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efda80bc7e0 con 0x7efdb4100b10 2024-09-10T07:46:48.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:48 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3814340057' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T07:46:49.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.063+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}) -- 0x7efdb40627f0 con 0x7efd9c0a2bb0 2024-09-10T07:46:49.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.071+0000 7efda37fe640 1 -- 172.21.15.159:0/3640729063 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7efdb40627f0 con 0x7efd9c0a2bb0 2024-09-10T07:46:49.070 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mds.all update... 2024-09-10T07:46:49.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efd9c0a2bb0 msgr2=0x7efd9c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efd9c0a2bb0 0x7efd9c0a5070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efda4005fd0 tx=0x7efda4005850 comp rx=0 tx=0).stop 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 msgr2=0x7efdb406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 0x7efdb406b2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efda8031610 tx=0x7efda80043b0 comp rx=0 tx=0).stop 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 shutdown_connections 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efd9c0a2bb0 0x7efd9c0a5070 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdb41026d0 0x7efdb41a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb4101d10 0x7efdb419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 --2- 172.21.15.159:0/3640729063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb4100b10 0x7efdb406b2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 >> 172.21.15.159:0/3640729063 conn(0x7efdb40fc2a0 msgr2=0x7efdb4105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 shutdown_connections 2024-09-10T07:46:49.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T07:46:49.073+0000 7efdb8e9a640 1 -- 172.21.15.159:0/3640729063 wait complete. 2024-09-10T07:46:49.760 DEBUG:teuthology.orchestra.run.smithi073:mds.a> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T07:46:49.763 DEBUG:teuthology.orchestra.run.smithi073:mds.d> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T07:46:49.806 DEBUG:teuthology.orchestra.run.smithi073:mds.g> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T07:46:49.827 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:49 smithi073 ceph-mon[30850]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:49.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:49.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:49.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:49.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:49.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:49.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:49.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:49.828 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:49 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:49.829 DEBUG:teuthology.orchestra.run.smithi073:mds.j> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T07:46:49.871 DEBUG:teuthology.orchestra.run.smithi102:mds.b> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T07:46:49.873 DEBUG:teuthology.orchestra.run.smithi102:mds.e> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T07:46:49.875 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:49 smithi102 ceph-mon[35514]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:49.875 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:49 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:49.877 DEBUG:teuthology.orchestra.run.smithi102:mds.h> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T07:46:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:49 smithi159 ceph-mon[35522]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:46:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:46:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:49.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:49 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:49.920 DEBUG:teuthology.orchestra.run.smithi102:mds.k> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T07:46:49.963 DEBUG:teuthology.orchestra.run.smithi159:mds.c> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T07:46:49.965 DEBUG:teuthology.orchestra.run.smithi159:mds.f> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T07:46:50.008 DEBUG:teuthology.orchestra.run.smithi159:mds.i> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T07:46:50.051 DEBUG:teuthology.orchestra.run.smithi159:mds.l> sudo journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T07:46:50.094 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T07:46:50.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:46:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:46:50.702 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:50 smithi073 ceph-mon[30850]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:46:50.702 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:50 smithi073 ceph-mon[30850]: Saving service mds.all spec with placement smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-09-10T07:46:50.702 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:50 smithi073 ceph-mon[30850]: Deploying daemon mds.l on smithi159 2024-09-10T07:46:50.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 -- 172.21.15.73:0/3364856896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c100a80 msgr2=0x7fb26c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 --2- 172.21.15.73:0/3364856896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c100a80 0x7fb26c100ee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb254009930 tx=0x7fb25402a420 comp rx=0 tx=0).stop 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 -- 172.21.15.73:0/3364856896 shutdown_connections 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 --2- 172.21.15.73:0/3364856896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb26c101420 0x7fb26c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 --2- 172.21.15.73:0/3364856896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c100a80 0x7fb26c100ee0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 --2- 172.21.15.73:0/3364856896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c106a80 0x7fb26c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 -- 172.21.15.73:0/3364856896 >> 172.21.15.73:0/3364856896 conn(0x7fb26c0fc7a0 msgr2=0x7fb26c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 -- 172.21.15.73:0/3364856896 shutdown_connections 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 -- 172.21.15.73:0/3364856896 wait complete. 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 Processor -- start 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.782+0000 7fb271d9e640 1 -- start start 2024-09-10T07:46:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb271d9e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c100a80 0x7fb26c0fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb271d9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c101420 0x7fb26c0fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb271d9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb26c106a80 0x7fb26c0fd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb271d9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c110e40 con 0x7fb26c101420 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb271d9e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c110cc0 con 0x7fb26c106a80 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb271d9e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c110fc0 con 0x7fb26c100a80 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb262ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c101420 0x7fb26c0fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb262ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c101420 0x7fb26c0fd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34022/0 (socket says 172.21.15.73:34022) 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb262ffd640 1 -- 172.21.15.73:0/1044119850 learned_addr learned my addr 172.21.15.73:0/1044119850 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb26bfff640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb26c106a80 0x7fb26c0fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb26b7fe640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c100a80 0x7fb26c0fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb262ffd640 1 -- 172.21.15.73:0/1044119850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c100a80 msgr2=0x7fb26c0fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:50.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb262ffd640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c100a80 0x7fb26c0fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb262ffd640 1 -- 172.21.15.73:0/1044119850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb26c106a80 msgr2=0x7fb26c0fd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb262ffd640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb26c106a80 0x7fb26c0fd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb262ffd640 1 -- 172.21.15.73:0/1044119850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c1a6910 con 0x7fb26c101420 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb26bfff640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb26c106a80 0x7fb26c0fd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.783+0000 7fb262ffd640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c101420 0x7fb26c0fd2d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb254009230 tx=0x7fb254004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.784+0000 7fb2697fa640 1 -- 172.21.15.73:0/1044119850 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25403f030 con 0x7fb26c101420 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.784+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26c1a6ba0 con 0x7fb26c101420 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.784+0000 7fb2697fa640 1 -- 172.21.15.73:0/1044119850 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb254003ad0 con 0x7fb26c101420 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.784+0000 7fb2697fa640 1 -- 172.21.15.73:0/1044119850 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254035070 con 0x7fb26c101420 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.784+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb26c1a70d0 con 0x7fb26c101420 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.785+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26c100ee0 con 0x7fb26c101420 2024-09-10T07:46:50.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.786+0000 7fb2697fa640 1 -- 172.21.15.73:0/1044119850 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb254042030 con 0x7fb26c101420 2024-09-10T07:46:50.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.787+0000 7fb2697fa640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb2580a2b80 0x7fb2580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:50.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.787+0000 7fb26b7fe640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb2580a2b80 0x7fb2580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:50.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.787+0000 7fb2697fa640 1 -- 172.21.15.73:0/1044119850 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fb2540eede0 con 0x7fb26c101420 2024-09-10T07:46:50.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.787+0000 7fb26b7fe640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb2580a2b80 0x7fb2580a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00cac0 tx=0x7fb25c00c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:50.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.791+0000 7fb2697fa640 1 -- 172.21.15.73:0/1044119850 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2540bc1e0 con 0x7fb26c101420 2024-09-10T07:46:50.845 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:50 smithi159 ceph-mon[35522]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:46:50.845 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:50 smithi159 ceph-mon[35522]: Saving service mds.all spec with placement smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-09-10T07:46:50.845 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:50 smithi159 ceph-mon[35522]: Deploying daemon mds.l on smithi159 2024-09-10T07:46:50.875 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:50 smithi102 ceph-mon[35514]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:46:50.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:50 smithi102 ceph-mon[35514]: Saving service mds.all spec with placement smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-09-10T07:46:50.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:50 smithi102 ceph-mon[35514]: Deploying daemon mds.l on smithi159 2024-09-10T07:46:50.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.991+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb26c10a020 con 0x7fb26c101420 2024-09-10T07:46:50.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.992+0000 7fb2697fa640 1 -- 172.21.15.73:0/1044119850 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fb2540bbae0 con 0x7fb26c101420 2024-09-10T07:46:50.992 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:46:50.992 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"btime":"2024-09-10T07:39:59:864905+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T07:46:50.992 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 1 2024-09-10T07:46:50.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb2580a2b80 msgr2=0x7fb2580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:50.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb2580a2b80 0x7fb2580a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00cac0 tx=0x7fb25c00c4a0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c101420 msgr2=0x7fb26c0fd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:50.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c101420 0x7fb26c0fd2d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb254009230 tx=0x7fb254004270 comp rx=0 tx=0).stop 2024-09-10T07:46:50.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 shutdown_connections 2024-09-10T07:46:50.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb2580a2b80 0x7fb2580a5040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb26c106a80 0x7fb26c0fd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb26c101420 0x7fb26c0fd2d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 --2- 172.21.15.73:0/1044119850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c100a80 0x7fb26c0fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:50.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 >> 172.21.15.73:0/1044119850 conn(0x7fb26c0fc7a0 msgr2=0x7fb26c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:50.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 shutdown_connections 2024-09-10T07:46:50.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:50.994+0000 7fb271d9e640 1 -- 172.21.15.73:0/1044119850 wait complete. 2024-09-10T07:46:51.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:51 smithi073 ceph-mon[30850]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:51.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:51 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1044119850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:46:51.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:51 smithi102 ceph-mon[35514]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:51.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:51 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1044119850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:46:51.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:51 smithi159 ceph-mon[35522]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:51.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:51 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1044119850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:46:51.908 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 10 07:46:51 smithi159 systemd[1]: Started Ceph mds.l for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:46:52.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:52 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.159:6832/4146480241,v1:172.21.15.159:6833/4146480241] up:boot 2024-09-10T07:46:52.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:52 smithi102 ceph-mon[35514]: fsmap 1 up:standby 2024-09-10T07:46:52.878 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T07:46:52.878 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:52.878 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:52.878 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:52.878 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:52.878 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:52.879 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:52 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:52.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:52 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.159:6832/4146480241,v1:172.21.15.159:6833/4146480241] up:boot 2024-09-10T07:46:52.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:52 smithi073 ceph-mon[30850]: fsmap 1 up:standby 2024-09-10T07:46:52.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T07:46:52.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:52.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:52.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:52.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:52.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:52.974 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:52 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:52 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.159:6832/4146480241,v1:172.21.15.159:6833/4146480241] up:boot 2024-09-10T07:46:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:52 smithi159 ceph-mon[35522]: fsmap 1 up:standby 2024-09-10T07:46:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T07:46:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:53.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:53.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:53.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:52 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:53.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:46:53.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:53 smithi073 ceph-mon[30850]: Deploying daemon mds.k on smithi102 2024-09-10T07:46:53.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:53 smithi073 ceph-mon[30850]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:54.031 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:53 smithi102 ceph-mon[35514]: Deploying daemon mds.k on smithi102 2024-09-10T07:46:54.031 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:53 smithi102 ceph-mon[35514]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:54.032 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 07:46:53 smithi102 systemd[1]: Starting Ceph mds.k for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:46:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:53 smithi159 ceph-mon[35522]: Deploying daemon mds.k on smithi102 2024-09-10T07:46:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:53 smithi159 ceph-mon[35522]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:54.310 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 07:46:54 smithi102 podman[64417]: 2024-09-10 07:46:53.934755606 +0000 UTC m=+0.015551912 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:46:54.310 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 07:46:54 smithi102 podman[64417]: 2024-09-10 07:46:54.055675061 +0000 UTC m=+0.136471350 container create 2239ec040b2205ddfba1fdbe54d69277c6323956c95ac2b16c54d327f2c6542d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:46:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.364+0000 7f6cb68df640 1 -- 172.21.15.73:0/1921353909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 msgr2=0x7f6cb0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.364+0000 7f6cb68df640 1 --2- 172.21.15.73:0/1921353909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 0x7f6cb0106e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009930 tx=0x7f6ca002a420 comp rx=0 tx=0).stop 2024-09-10T07:46:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.365+0000 7f6cb68df640 1 -- 172.21.15.73:0/1921353909 shutdown_connections 2024-09-10T07:46:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.365+0000 7f6cb68df640 1 --2- 172.21.15.73:0/1921353909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb0101420 0x7f6cb010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.365+0000 7f6cb68df640 1 --2- 172.21.15.73:0/1921353909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb0100a80 0x7f6cb0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.365+0000 7f6cb68df640 1 --2- 172.21.15.73:0/1921353909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 0x7f6cb0106e60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.365+0000 7f6cb68df640 1 -- 172.21.15.73:0/1921353909 >> 172.21.15.73:0/1921353909 conn(0x7f6cb00fc7a0 msgr2=0x7f6cb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.365+0000 7f6cb68df640 1 -- 172.21.15.73:0/1921353909 shutdown_connections 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.365+0000 7f6cb68df640 1 -- 172.21.15.73:0/1921353909 wait complete. 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.365+0000 7f6cb68df640 1 Processor -- start 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.365+0000 7f6cb68df640 1 -- start start 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb68df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb0100a80 0x7f6cb00fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb68df640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb0101420 0x7f6cb00fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb68df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 0x7f6cb00fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb68df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0110e90 con 0x7f6cb0106a80 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb68df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0110d10 con 0x7f6cb0100a80 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb68df640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0111010 con 0x7f6cb0101420 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb4e7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 0x7f6cb00fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb4e7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 0x7f6cb00fd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34038/0 (socket says 172.21.15.73:34038) 2024-09-10T07:46:54.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb4e7c640 1 -- 172.21.15.73:0/4041901473 learned_addr learned my addr 172.21.15.73:0/4041901473 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6caffff640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb0100a80 0x7f6cb00fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6caf7fe640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb0101420 0x7f6cb00fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb4e7c640 1 -- 172.21.15.73:0/4041901473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb0101420 msgr2=0x7f6cb00fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb4e7c640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb0101420 0x7f6cb00fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb4e7c640 1 -- 172.21.15.73:0/4041901473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb0100a80 msgr2=0x7f6cb00fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb4e7c640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb0100a80 0x7f6cb00fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb4e7c640 1 -- 172.21.15.73:0/4041901473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb01a68b0 con 0x7f6cb0106a80 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6caffff640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb0100a80 0x7f6cb00fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cb4e7c640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 0x7f6cb00fd7c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009fd0 tx=0x7f6ca800def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.366+0000 7f6cad7fa640 1 -- 172.21.15.73:0/4041901473 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8017070 con 0x7f6cb0106a80 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.367+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb01a6ba0 con 0x7f6cb0106a80 2024-09-10T07:46:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.367+0000 7f6cad7fa640 1 -- 172.21.15.73:0/4041901473 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca8003e50 con 0x7f6cb0106a80 2024-09-10T07:46:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.367+0000 7f6cad7fa640 1 -- 172.21.15.73:0/4041901473 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8010460 con 0x7f6cb0106a80 2024-09-10T07:46:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.367+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb01a70e0 con 0x7f6cb0106a80 2024-09-10T07:46:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.368+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb0100ee0 con 0x7f6cb0106a80 2024-09-10T07:46:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.369+0000 7f6cad7fa640 1 -- 172.21.15.73:0/4041901473 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6ca8003970 con 0x7f6cb0106a80 2024-09-10T07:46:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.369+0000 7f6cad7fa640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6c980a2b80 0x7f6c980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.369+0000 7f6caffff640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6c980a2b80 0x7f6c980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.370+0000 7f6cad7fa640 1 -- 172.21.15.73:0/4041901473 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f6ca80ce790 con 0x7f6cb0106a80 2024-09-10T07:46:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.370+0000 7f6caffff640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6c980a2b80 0x7f6c980a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0006010 tx=0x7f6ca0031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.373+0000 7f6cad7fa640 1 -- 172.21.15.73:0/4041901473 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ca809bb90 con 0x7f6cb0106a80 2024-09-10T07:46:54.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.594+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cb002d7c0 con 0x7f6cb0106a80 2024-09-10T07:46:54.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.594+0000 7f6cad7fa640 1 -- 172.21.15.73:0/4041901473 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f6ca809b490 con 0x7f6cb0106a80 2024-09-10T07:46:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:46:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"btime":"2024-09-10T07:46:51:675327+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T07:46:54.594 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-09-10T07:46:54.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6c980a2b80 msgr2=0x7f6c980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:54.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6c980a2b80 0x7f6c980a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0006010 tx=0x7f6ca0031510 comp rx=0 tx=0).stop 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 msgr2=0x7f6cb00fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 0x7f6cb00fd7c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009fd0 tx=0x7f6ca800def0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 shutdown_connections 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6c980a2b80 0x7f6c980a5040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cb0106a80 0x7f6cb00fd7c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb0101420 0x7f6cb00fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 --2- 172.21.15.73:0/4041901473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb0100a80 0x7f6cb00fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 >> 172.21.15.73:0/4041901473 conn(0x7f6cb00fc7a0 msgr2=0x7f6cb006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 shutdown_connections 2024-09-10T07:46:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:54.597+0000 7f6cb68df640 1 -- 172.21.15.73:0/4041901473 wait complete. 2024-09-10T07:46:54.626 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 07:46:54 smithi102 podman[64417]: 2024-09-10 07:46:54.311334113 +0000 UTC m=+0.392130408 container init 2239ec040b2205ddfba1fdbe54d69277c6323956c95ac2b16c54d327f2c6542d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T07:46:54.626 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 07:46:54 smithi102 podman[64417]: 2024-09-10 07:46:54.31428496 +0000 UTC m=+0.395081250 container start 2239ec040b2205ddfba1fdbe54d69277c6323956c95ac2b16c54d327f2c6542d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T07:46:54.626 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 07:46:54 smithi102 ceph-mds[64436]: -- 172.21.15.102:0/2052601815 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eb8c3a3c20 con 0x55eb8c381400 2024-09-10T07:46:54.626 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 07:46:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-k[64432]: starting mds.k at 2024-09-10T07:46:54.626 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 07:46:54 smithi102 bash[64417]: 2239ec040b2205ddfba1fdbe54d69277c6323956c95ac2b16c54d327f2c6542d 2024-09-10T07:46:54.626 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 07:46:54 smithi102 systemd[1]: Started Ceph mds.k for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:46:55.655 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:55.655 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: Deploying daemon mds.j on smithi073 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4041901473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.102:6832/440517114,v1:172.21.15.102:6833/440517114] up:boot 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: fsmap 2 up:standby 2024-09-10T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:55 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T07:46:55.749 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:55.749 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:55.749 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:55.749 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:55.749 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:55.749 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:55.749 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: Deploying daemon mds.j on smithi073 2024-09-10T07:46:55.750 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/4041901473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:46:55.750 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:55.750 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.102:6832/440517114,v1:172.21.15.102:6833/440517114] up:boot 2024-09-10T07:46:55.750 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: fsmap 2 up:standby 2024-09-10T07:46:55.750 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:55 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T07:46:55.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:55.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:55.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:55.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:55.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:55.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:55.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: Deploying daemon mds.j on smithi073 2024-09-10T07:46:55.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/4041901473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:46:55.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:55.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.102:6832/440517114,v1:172.21.15.102:6833/440517114] up:boot 2024-09-10T07:46:55.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: fsmap 2 up:standby 2024-09-10T07:46:55.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:55 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T07:46:57.146 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 07:46:56 smithi073 systemd[1]: Starting Ceph mds.j for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:46:57.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:46:57.411 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 07:46:57 smithi073 podman[71327]: 2024-09-10 07:46:57.0499177 +0000 UTC m=+0.015596455 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:46:57.411 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 07:46:57 smithi073 podman[71327]: 2024-09-10 07:46:57.167781746 +0000 UTC m=+0.133460506 container create 4e98fc235b7fd3ef1e350480c233b7fc99964502886534a2973e42a0e79d98a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T07:46:57.411 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 07:46:57 smithi073 podman[71327]: 2024-09-10 07:46:57.412297454 +0000 UTC m=+0.377976207 container init 4e98fc235b7fd3ef1e350480c233b7fc99964502886534a2973e42a0e79d98a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T07:46:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:46:57.714 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 07:46:57 smithi073 podman[71327]: 2024-09-10 07:46:57.416079793 +0000 UTC m=+0.381758545 container start 4e98fc235b7fd3ef1e350480c233b7fc99964502886534a2973e42a0e79d98a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T07:46:57.714 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 07:46:57 smithi073 ceph-mds[71365]: -- 172.21.15.73:0/158845951 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a72d975860 con 0x55a72d952800 2024-09-10T07:46:57.714 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 07:46:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-j[71343]: starting mds.j at 2024-09-10T07:46:57.714 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 07:46:57 smithi073 bash[71327]: 4e98fc235b7fd3ef1e350480c233b7fc99964502886534a2973e42a0e79d98a1 2024-09-10T07:46:57.714 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 07:46:57 smithi073 systemd[1]: Started Ceph mds.j for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:46:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:57 smithi073 ceph-mon[30850]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:57.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:57.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:57.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:57.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:57 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:57 smithi102 ceph-mon[35514]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:58.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:58.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:57 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:58.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.129+0000 7f145333b640 1 -- 172.21.15.73:0/1036876846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c106a80 msgr2=0x7f144c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.129+0000 7f145333b640 1 --2- 172.21.15.73:0/1036876846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c106a80 0x7f144c106e60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1448009930 tx=0x7f144802a420 comp rx=0 tx=0).stop 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 -- 172.21.15.73:0/1036876846 shutdown_connections 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 --2- 172.21.15.73:0/1036876846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f144c101420 0x7f144c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 --2- 172.21.15.73:0/1036876846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f144c100a80 0x7f144c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 --2- 172.21.15.73:0/1036876846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c106a80 0x7f144c106e60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 -- 172.21.15.73:0/1036876846 >> 172.21.15.73:0/1036876846 conn(0x7f144c0fc7a0 msgr2=0x7f144c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 -- 172.21.15.73:0/1036876846 shutdown_connections 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 -- 172.21.15.73:0/1036876846 wait complete. 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 Processor -- start 2024-09-10T07:46:58.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 -- start start 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c100a80 0x7f144c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f144c101420 0x7f144c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f144c106a80 0x7f144c1a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.130+0000 7f145333b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f144c110ea0 con 0x7f144c100a80 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f145333b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f144c110d20 con 0x7f144c101420 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f145333b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f144c111020 con 0x7f144c106a80 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14510d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c100a80 0x7f144c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14510d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c100a80 0x7f144c1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34064/0 (socket says 172.21.15.73:34064) 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14510d7640 1 -- 172.21.15.73:0/2167160179 learned_addr learned my addr 172.21.15.73:0/2167160179 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14508d6640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f144c101420 0x7f144c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14510d7640 1 -- 172.21.15.73:0/2167160179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f144c106a80 msgr2=0x7f144c1a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14518d8640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f144c106a80 0x7f144c1a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14510d7640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f144c106a80 0x7f144c1a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14510d7640 1 -- 172.21.15.73:0/2167160179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f144c101420 msgr2=0x7f144c199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14510d7640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f144c101420 0x7f144c199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14510d7640 1 -- 172.21.15.73:0/2167160179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144c1a4890 con 0x7f144c100a80 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14518d8640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f144c106a80 0x7f144c1a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14510d7640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c100a80 0x7f144c1992d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1448009a50 tx=0x7f1448004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14427fc640 1 -- 172.21.15.73:0/2167160179 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144803f030 con 0x7f144c100a80 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144c1a4a60 con 0x7f144c100a80 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14427fc640 1 -- 172.21.15.73:0/2167160179 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1448003ce0 con 0x7f144c100a80 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f14427fc640 1 -- 172.21.15.73:0/2167160179 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448035070 con 0x7f144c100a80 2024-09-10T07:46:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.131+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f144c1a4f10 con 0x7f144c100a80 2024-09-10T07:46:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.132+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f144c100ee0 con 0x7f144c100a80 2024-09-10T07:46:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.133+0000 7f14427fc640 1 -- 172.21.15.73:0/2167160179 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1448042030 con 0x7f144c100a80 2024-09-10T07:46:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.134+0000 7f14427fc640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f14380a2b80 0x7f14380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.134+0000 7f14508d6640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f14380a2b80 0x7f14380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.134+0000 7f14427fc640 1 -- 172.21.15.73:0/2167160179 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f14480ef630 con 0x7f144c100a80 2024-09-10T07:46:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.135+0000 7f14508d6640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f14380a2b80 0x7f14380a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f144c06b320 tx=0x7f143c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.138+0000 7f14427fc640 1 -- 172.21.15.73:0/2167160179 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14480bc990 con 0x7f144c100a80 2024-09-10T07:46:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:57 smithi159 ceph-mon[35522]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:46:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:46:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:46:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:46:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:57 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:46:58.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.357+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f144c06adc0 con 0x7f144c100a80 2024-09-10T07:46:58.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.358+0000 7f14427fc640 1 -- 172.21.15.73:0/2167160179 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f14480bc290 con 0x7f144c100a80 2024-09-10T07:46:58.358 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:46:58.358 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":4,"btime":"2024-09-10T07:46:57:704365+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T07:46:58.358 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 4 2024-09-10T07:46:58.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f14380a2b80 msgr2=0x7f14380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:58.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f14380a2b80 0x7f14380a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f144c06b320 tx=0x7f143c00a2d0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c100a80 msgr2=0x7f144c1992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:58.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c100a80 0x7f144c1992d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1448009a50 tx=0x7f1448004270 comp rx=0 tx=0).stop 2024-09-10T07:46:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 shutdown_connections 2024-09-10T07:46:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f14380a2b80 0x7f14380a5040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f144c106a80 0x7f144c1a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f144c101420 0x7f144c199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 --2- 172.21.15.73:0/2167160179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f144c100a80 0x7f144c1992d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 >> 172.21.15.73:0/2167160179 conn(0x7f144c0fc7a0 msgr2=0x7f144c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 shutdown_connections 2024-09-10T07:46:58.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:46:58.360+0000 7f145333b640 1 -- 172.21.15.73:0/2167160179 wait complete. 2024-09-10T07:46:58.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:58 smithi073 ceph-mon[30850]: Deploying daemon mds.d on smithi073 2024-09-10T07:46:58.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:58 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.73:6834/2591378942,v1:172.21.15.73:6835/2591378942] up:boot 2024-09-10T07:46:58.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:58 smithi073 ceph-mon[30850]: fsmap 3 up:standby 2024-09-10T07:46:58.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:58 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T07:46:58.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:58 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2167160179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:46:59.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:58 smithi102 ceph-mon[35514]: Deploying daemon mds.d on smithi073 2024-09-10T07:46:59.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:58 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.73:6834/2591378942,v1:172.21.15.73:6835/2591378942] up:boot 2024-09-10T07:46:59.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:58 smithi102 ceph-mon[35514]: fsmap 3 up:standby 2024-09-10T07:46:59.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:58 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T07:46:59.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:58 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2167160179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:46:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:58 smithi159 ceph-mon[35522]: Deploying daemon mds.d on smithi073 2024-09-10T07:46:59.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:58 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.73:6834/2591378942,v1:172.21.15.73:6835/2591378942] up:boot 2024-09-10T07:46:59.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:58 smithi159 ceph-mon[35522]: fsmap 3 up:standby 2024-09-10T07:46:59.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:58 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T07:46:59.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:58 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2167160179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:46:59.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:46:59 smithi073 ceph-mon[30850]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:00.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:46:59 smithi102 ceph-mon[35514]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:46:59 smithi159 ceph-mon[35522]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:00.655 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 07:47:00 smithi073 systemd[1]: Starting Ceph mds.d for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:47:00.973 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 07:47:00 smithi073 podman[71744]: 2024-09-10 07:47:00.656204535 +0000 UTC m=+0.108394018 container create ec0bbc1f0b4cab443517d264cc30c578cec1f6c956f3f43367fa58213ec068aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T07:47:00.973 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 07:47:00 smithi073 podman[71744]: 2024-09-10 07:47:00.563360349 +0000 UTC m=+0.015549832 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:47:00.973 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 07:47:00 smithi073 podman[71744]: 2024-09-10 07:47:00.867423599 +0000 UTC m=+0.319613082 container init ec0bbc1f0b4cab443517d264cc30c578cec1f6c956f3f43367fa58213ec068aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T07:47:00.973 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 07:47:00 smithi073 podman[71744]: 2024-09-10 07:47:00.870325674 +0000 UTC m=+0.322515156 container start ec0bbc1f0b4cab443517d264cc30c578cec1f6c956f3f43367fa58213ec068aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T07:47:00.973 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 07:47:00 smithi073 ceph-mds[71763]: -- 172.21.15.73:0/1043096864 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa9cb8f860 con 0x55aa9cb6d400 2024-09-10T07:47:00.973 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 07:47:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-d[71759]: starting mds.d at 2024-09-10T07:47:01.473 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 07:47:00 smithi073 bash[71744]: ec0bbc1f0b4cab443517d264cc30c578cec1f6c956f3f43367fa58213ec068aa 2024-09-10T07:47:01.473 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 07:47:00 smithi073 systemd[1]: Started Ceph mds.d for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:47:01.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:47:01.832 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:01.953 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:01 smithi073 ceph-mon[30850]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:01.953 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:01.953 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:01.953 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:01.953 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:01.953 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:01.953 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:01 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:01 smithi102 ceph-mon[35514]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:02.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:01 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:01 smithi159 ceph-mon[35522]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:01 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:02.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 -- 172.21.15.73:0/2184171880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710101de0 msgr2=0x7f57101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:02.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 --2- 172.21.15.73:0/2184171880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710101de0 0x7f57101021c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5700009ca0 tx=0x7f570002a8c0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 -- 172.21.15.73:0/2184171880 shutdown_connections 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 --2- 172.21.15.73:0/2184171880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5710106f10 0x7f571010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 --2- 172.21.15.73:0/2184171880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5710102790 0x7f57101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 --2- 172.21.15.73:0/2184171880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710101de0 0x7f57101021c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 -- 172.21.15.73:0/2184171880 >> 172.21.15.73:0/2184171880 conn(0x7f57100fd8c0 msgr2=0x7f57100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 -- 172.21.15.73:0/2184171880 shutdown_connections 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 -- 172.21.15.73:0/2184171880 wait complete. 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 Processor -- start 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.261+0000 7f571602c640 1 -- start start 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f571602c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5710101de0 0x7f571019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f571602c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710102790 0x7f571019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f571602c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5710106f10 0x7f571019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f571602c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5710111f30 con 0x7f5710102790 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f571602c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5710111db0 con 0x7f5710101de0 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f571602c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f57101120b0 con 0x7f5710106f10 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710102790 0x7f571019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710102790 0x7f571019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54030/0 (socket says 172.21.15.73:54030) 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570effd640 1 -- 172.21.15.73:0/3351530981 learned_addr learned my addr 172.21.15.73:0/3351530981 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570f7fe640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5710101de0 0x7f571019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570ffff640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5710106f10 0x7f571019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570effd640 1 -- 172.21.15.73:0/3351530981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5710106f10 msgr2=0x7f571019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570effd640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5710106f10 0x7f571019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570effd640 1 -- 172.21.15.73:0/3351530981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5710101de0 msgr2=0x7f571019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570effd640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5710101de0 0x7f571019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570effd640 1 -- 172.21.15.73:0/3351530981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571019f6a0 con 0x7f5710102790 2024-09-10T07:47:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570ffff640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5710106f10 0x7f571019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570effd640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710102790 0x7f571019ac30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f570400d950 tx=0x7f570400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570cff9640 1 -- 172.21.15.73:0/3351530981 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5704017030 con 0x7f5710102790 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571019f990 con 0x7f5710102790 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570cff9640 1 -- 172.21.15.73:0/3351530981 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5704004020 con 0x7f5710102790 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f570cff9640 1 -- 172.21.15.73:0/3351530981 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57040047a0 con 0x7f5710102790 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.262+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57101a7270 con 0x7f5710102790 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.263+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57101021c0 con 0x7f5710102790 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.264+0000 7f570cff9640 1 -- 172.21.15.73:0/3351530981 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f57040041d0 con 0x7f5710102790 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.265+0000 7f570cff9640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f56f80a2b80 0x7f56f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.265+0000 7f570f7fe640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f56f80a2b80 0x7f56f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.265+0000 7f570cff9640 1 -- 172.21.15.73:0/3351530981 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f57040ce580 con 0x7f5710102790 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.266+0000 7f570f7fe640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f56f80a2b80 0x7f56f80a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5700006010 tx=0x7f5700009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.270+0000 7f570cff9640 1 -- 172.21.15.73:0/3351530981 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f570409b980 con 0x7f5710102790 2024-09-10T07:47:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.470+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57101a74d0 con 0x7f5710102790 2024-09-10T07:47:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.471+0000 7f570cff9640 1 -- 172.21.15.73:0/3351530981 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f570409b280 con 0x7f5710102790 2024-09-10T07:47:02.470 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:02.470 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"btime":"2024-09-10T07:47:01:721709+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T07:47:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-09-10T07:47:02.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f56f80a2b80 msgr2=0x7f56f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:02.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f56f80a2b80 0x7f56f80a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5700006010 tx=0x7f5700009360 comp rx=0 tx=0).stop 2024-09-10T07:47:02.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710102790 msgr2=0x7f571019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:02.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710102790 0x7f571019ac30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f570400d950 tx=0x7f570400de10 comp rx=0 tx=0).stop 2024-09-10T07:47:02.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 shutdown_connections 2024-09-10T07:47:02.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f56f80a2b80 0x7f56f80a5040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5710106f10 0x7f571019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5710102790 0x7f571019ac30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 --2- 172.21.15.73:0/3351530981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5710101de0 0x7f571019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:02.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 >> 172.21.15.73:0/3351530981 conn(0x7f57100fd8c0 msgr2=0x7f57100fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:02.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 shutdown_connections 2024-09-10T07:47:02.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:02.473+0000 7f571602c640 1 -- 172.21.15.73:0/3351530981 wait complete. 2024-09-10T07:47:02.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:02 smithi102 ceph-mon[35514]: Deploying daemon mds.e on smithi102 2024-09-10T07:47:02.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:02 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.73:6836/960559845,v1:172.21.15.73:6837/960559845] up:boot 2024-09-10T07:47:02.840 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:02 smithi102 ceph-mon[35514]: fsmap 4 up:standby 2024-09-10T07:47:02.840 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:02 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T07:47:02.840 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:02 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3351530981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:03.126 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 07:47:03 smithi102 systemd[1]: Starting Ceph mds.e for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:47:03.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:02 smithi159 ceph-mon[35522]: Deploying daemon mds.e on smithi102 2024-09-10T07:47:03.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:02 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.73:6836/960559845,v1:172.21.15.73:6837/960559845] up:boot 2024-09-10T07:47:03.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:02 smithi159 ceph-mon[35522]: fsmap 4 up:standby 2024-09-10T07:47:03.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:02 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T07:47:03.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:02 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3351530981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:03.182 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:02 smithi073 ceph-mon[30850]: Deploying daemon mds.e on smithi102 2024-09-10T07:47:03.183 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:02 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.73:6836/960559845,v1:172.21.15.73:6837/960559845] up:boot 2024-09-10T07:47:03.183 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:02 smithi073 ceph-mon[30850]: fsmap 4 up:standby 2024-09-10T07:47:03.183 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:02 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T07:47:03.183 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:02 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3351530981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:03.506 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 07:47:03 smithi102 podman[64730]: 2024-09-10 07:47:03.144406189 +0000 UTC m=+0.015969927 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:47:03.506 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 07:47:03 smithi102 podman[64730]: 2024-09-10 07:47:03.253876473 +0000 UTC m=+0.125440268 container create 805291d919c298e8a272e2f59f57946cb1dfe305c8a166df474d815dcd917955 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T07:47:03.507 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 07:47:03 smithi102 podman[64730]: 2024-09-10 07:47:03.481256186 +0000 UTC m=+0.352819913 container init 805291d919c298e8a272e2f59f57946cb1dfe305c8a166df474d815dcd917955 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True) 2024-09-10T07:47:03.507 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 07:47:03 smithi102 podman[64730]: 2024-09-10 07:47:03.484052047 +0000 UTC m=+0.355615769 container start 805291d919c298e8a272e2f59f57946cb1dfe305c8a166df474d815dcd917955 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T07:47:03.507 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 07:47:03 smithi102 ceph-mds[64749]: -- 172.21.15.102:0/5194365 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dfe84a1860 con 0x55dfe847e800 2024-09-10T07:47:03.876 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 07:47:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e[64745]: starting mds.e at 2024-09-10T07:47:03.876 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 07:47:03 smithi102 bash[64730]: 805291d919c298e8a272e2f59f57946cb1dfe305c8a166df474d815dcd917955 2024-09-10T07:47:03.876 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 07:47:03 smithi102 systemd[1]: Started Ceph mds.e for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:47:03.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:03 smithi102 ceph-mon[35514]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:03.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:03.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:03.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:03.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:03.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:03.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:03 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:03 smithi159 ceph-mon[35522]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:03 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:03 smithi073 ceph-mon[30850]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:04.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:03 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:05.091 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:04 smithi159 ceph-mon[35522]: Deploying daemon mds.f on smithi159 2024-09-10T07:47:05.091 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:04 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.102:6834/2327482046,v1:172.21.15.102:6835/2327482046] up:boot 2024-09-10T07:47:05.092 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:04 smithi159 ceph-mon[35522]: fsmap 5 up:standby 2024-09-10T07:47:05.092 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:04 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T07:47:05.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:04 smithi102 ceph-mon[35514]: Deploying daemon mds.f on smithi159 2024-09-10T07:47:05.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:04 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.102:6834/2327482046,v1:172.21.15.102:6835/2327482046] up:boot 2024-09-10T07:47:05.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:04 smithi102 ceph-mon[35514]: fsmap 5 up:standby 2024-09-10T07:47:05.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:04 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T07:47:05.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:47:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:04 smithi073 ceph-mon[30850]: Deploying daemon mds.f on smithi159 2024-09-10T07:47:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:04 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.102:6834/2327482046,v1:172.21.15.102:6835/2327482046] up:boot 2024-09-10T07:47:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:04 smithi073 ceph-mon[30850]: fsmap 5 up:standby 2024-09-10T07:47:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:04 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T07:47:05.407 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 07:47:05 smithi159 systemd[1]: Starting Ceph mds.f for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:47:05.473 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:05.788 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:05 smithi159 ceph-mon[35522]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:05.788 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 07:47:05 smithi159 podman[65503]: 2024-09-10 07:47:05.430081444 +0000 UTC m=+0.016750737 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:47:05.789 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 07:47:05 smithi159 podman[65503]: 2024-09-10 07:47:05.53582026 +0000 UTC m=+0.122489536 container create 4eb1658c4f8e8842f402473690efcde2f4ce82b94a517d5719a31d5c0ae535ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T07:47:05.789 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 07:47:05 smithi159 podman[65503]: 2024-09-10 07:47:05.763473308 +0000 UTC m=+0.350142585 container init 4eb1658c4f8e8842f402473690efcde2f4ce82b94a517d5719a31d5c0ae535ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T07:47:05.789 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 07:47:05 smithi159 podman[65503]: 2024-09-10 07:47:05.76662772 +0000 UTC m=+0.353297010 container start 4eb1658c4f8e8842f402473690efcde2f4ce82b94a517d5719a31d5c0ae535ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:47:05.789 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 07:47:05 smithi159 ceph-mds[65522]: -- 172.21.15.159:0/1865052167 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce11c1f860 con 0x55ce11bfd000 2024-09-10T07:47:05.886 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:05 smithi073 ceph-mon[30850]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:05.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.970+0000 7f58aca3e640 1 -- 172.21.15.73:0/3961301270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 msgr2=0x7f58a81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:05.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.970+0000 7f58aca3e640 1 --2- 172.21.15.73:0/3961301270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 0x7f58a81067e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5890009900 tx=0x7f589002a410 comp rx=0 tx=0).stop 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.970+0000 7f58aca3e640 1 -- 172.21.15.73:0/3961301270 shutdown_connections 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.970+0000 7f58aca3e640 1 --2- 172.21.15.73:0/3961301270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58a8106f10 0x7f58a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.970+0000 7f58aca3e640 1 --2- 172.21.15.73:0/3961301270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 0x7f58a81067e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.970+0000 7f58aca3e640 1 --2- 172.21.15.73:0/3961301270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8101de0 0x7f58a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.970+0000 7f58aca3e640 1 -- 172.21.15.73:0/3961301270 >> 172.21.15.73:0/3961301270 conn(0x7f58a80fd8c0 msgr2=0x7f58a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.970+0000 7f58aca3e640 1 -- 172.21.15.73:0/3961301270 shutdown_connections 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.970+0000 7f58aca3e640 1 -- 172.21.15.73:0/3961301270 wait complete. 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58aca3e640 1 Processor -- start 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58aca3e640 1 -- start start 2024-09-10T07:47:05.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58aca3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58a8101de0 0x7f58a81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58aca3e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 0x7f58a81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58aca3e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8106f10 0x7f58a819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58aca3e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f58a8111f70 con 0x7f58a8102790 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58aca3e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f58a8111df0 con 0x7f58a8101de0 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58aca3e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f58a81120f0 con 0x7f58a8106f10 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f589ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 0x7f58a81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f589ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 0x7f58a81988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54052/0 (socket says 172.21.15.73:54052) 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f589ffff640 1 -- 172.21.15.73:0/2497799104 learned_addr learned my addr 172.21.15.73:0/2497799104 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58a6d9d640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8106f10 0x7f58a819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58a659c640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58a8101de0 0x7f58a81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:05.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f589ffff640 1 -- 172.21.15.73:0/2497799104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8106f10 msgr2=0x7f58a819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f589ffff640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8106f10 0x7f58a819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f589ffff640 1 -- 172.21.15.73:0/2497799104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58a8101de0 msgr2=0x7f58a81983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f589ffff640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58a8101de0 0x7f58a81983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f589ffff640 1 -- 172.21.15.73:0/2497799104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a819d360 con 0x7f58a8102790 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.971+0000 7f58a659c640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58a8101de0 0x7f58a81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.972+0000 7f589ffff640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 0x7f58a81988f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5890006010 tx=0x7f58900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.972+0000 7f589f7fe640 1 -- 172.21.15.73:0/2497799104 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589003f030 con 0x7f58a8102790 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.972+0000 7f589f7fe640 1 -- 172.21.15.73:0/2497799104 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5890003ce0 con 0x7f58a8102790 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.972+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a819d5f0 con 0x7f58a8102790 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.972+0000 7f589f7fe640 1 -- 172.21.15.73:0/2497799104 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890035070 con 0x7f58a8102790 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.972+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a81a4f30 con 0x7f58a8102790 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.973+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a81032c0 con 0x7f58a8102790 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.974+0000 7f589f7fe640 1 -- 172.21.15.73:0/2497799104 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5890042030 con 0x7f58a8102790 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.975+0000 7f589f7fe640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f58940a2b80 0x7f58940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:05.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.975+0000 7f58a659c640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f58940a2b80 0x7f58940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:05.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.975+0000 7f589f7fe640 1 -- 172.21.15.73:0/2497799104 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f58900ef5a0 con 0x7f58a8102790 2024-09-10T07:47:05.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.975+0000 7f58a659c640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f58940a2b80 0x7f58940a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5898005fd0 tx=0x7f589800b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:05.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:05.978+0000 7f589f7fe640 1 -- 172.21.15.73:0/2497799104 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58900bc9c0 con 0x7f58a8102790 2024-09-10T07:47:06.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:05 smithi102 ceph-mon[35514]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:06.157 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 07:47:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-f[65518]: starting mds.f at 2024-09-10T07:47:06.157 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 07:47:05 smithi159 bash[65503]: 4eb1658c4f8e8842f402473690efcde2f4ce82b94a517d5719a31d5c0ae535ee 2024-09-10T07:47:06.157 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 07:47:05 smithi159 systemd[1]: Started Ceph mds.f for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:47:06.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.182+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58a810a150 con 0x7f58a8102790 2024-09-10T07:47:06.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.182+0000 7f589f7fe640 1 -- 172.21.15.73:0/2497799104 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7f58900bc2c0 con 0x7f58a8102790 2024-09-10T07:47:06.182 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:06.182 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"btime":"2024-09-10T07:47:03:731505+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T07:47:06.182 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-09-10T07:47:06.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f58940a2b80 msgr2=0x7f58940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:06.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f58940a2b80 0x7f58940a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5898005fd0 tx=0x7f589800b5f0 comp rx=0 tx=0).stop 2024-09-10T07:47:06.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 msgr2=0x7f58a81988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:06.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 0x7f58a81988f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5890006010 tx=0x7f58900042f0 comp rx=0 tx=0).stop 2024-09-10T07:47:06.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 shutdown_connections 2024-09-10T07:47:06.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f58940a2b80 0x7f58940a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:06.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8106f10 0x7f58a819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:06.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a8102790 0x7f58a81988f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:06.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 --2- 172.21.15.73:0/2497799104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58a8101de0 0x7f58a81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:06.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 >> 172.21.15.73:0/2497799104 conn(0x7f58a80fd8c0 msgr2=0x7f58a80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:06.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 shutdown_connections 2024-09-10T07:47:06.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:06.185+0000 7f58aca3e640 1 -- 172.21.15.73:0/2497799104 wait complete. 2024-09-10T07:47:07.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:07.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:07.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:07.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:07.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:07.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:07.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: Deploying daemon mds.c on smithi159 2024-09-10T07:47:07.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2497799104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:07.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:07.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.159:6834/3867563502,v1:172.21.15.159:6835/3867563502] up:boot 2024-09-10T07:47:07.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: fsmap 6 up:standby 2024-09-10T07:47:07.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:06 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T07:47:07.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:07.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:07.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:07.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:07.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:07.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:07.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: Deploying daemon mds.c on smithi159 2024-09-10T07:47:07.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2497799104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:07.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:07.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.159:6834/3867563502,v1:172.21.15.159:6835/3867563502] up:boot 2024-09-10T07:47:07.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: fsmap 6 up:standby 2024-09-10T07:47:07.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:06 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T07:47:07.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:07.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:07.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:07.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:07.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:07.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:07.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: Deploying daemon mds.c on smithi159 2024-09-10T07:47:07.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2497799104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:07.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:07.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.159:6834/3867563502,v1:172.21.15.159:6835/3867563502] up:boot 2024-09-10T07:47:07.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: fsmap 6 up:standby 2024-09-10T07:47:07.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:06 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T07:47:08.146 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 07:47:07 smithi159 systemd[1]: Starting Ceph mds.c for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:47:08.407 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 07:47:08 smithi159 podman[65806]: 2024-09-10 07:47:08.147189036 +0000 UTC m=+0.105208493 container create 6c194b5f1bea8fe7c7195dd8c30bceec31e57db743f13541f32db3fbe14c8284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:47:08.407 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 07:47:08 smithi159 podman[65806]: 2024-09-10 07:47:08.057699452 +0000 UTC m=+0.015718923 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:47:08.407 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 07:47:08 smithi159 podman[65806]: 2024-09-10 07:47:08.383212718 +0000 UTC m=+0.341232183 container init 6c194b5f1bea8fe7c7195dd8c30bceec31e57db743f13541f32db3fbe14c8284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T07:47:08.407 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 07:47:08 smithi159 podman[65806]: 2024-09-10 07:47:08.385977501 +0000 UTC m=+0.343996964 container start 6c194b5f1bea8fe7c7195dd8c30bceec31e57db743f13541f32db3fbe14c8284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T07:47:08.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:47:08.907 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 07:47:08 smithi159 ceph-mds[65825]: -- 172.21.15.159:0/3322955893 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ed85889860 con 0x55ed85867000 2024-09-10T07:47:08.907 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 07:47:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c[65821]: starting mds.c at 2024-09-10T07:47:08.907 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 07:47:08 smithi159 bash[65806]: 6c194b5f1bea8fe7c7195dd8c30bceec31e57db743f13541f32db3fbe14c8284 2024-09-10T07:47:08.907 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 07:47:08 smithi159 systemd[1]: Started Ceph mds.c for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:47:09.135 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:09.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.159:6836/1843594994,v1:172.21.15.159:6837/1843594994] up:boot 2024-09-10T07:47:09.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: fsmap 7 up:standby 2024-09-10T07:47:09.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T07:47:09.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:09.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:09.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:09.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:09.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:09.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:09.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: Deploying daemon mds.h on smithi102 2024-09-10T07:47:09.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:09 smithi102 ceph-mon[35514]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:09.670 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.159:6836/1843594994,v1:172.21.15.159:6837/1843594994] up:boot 2024-09-10T07:47:09.670 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: fsmap 7 up:standby 2024-09-10T07:47:09.670 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T07:47:09.670 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:09.670 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:09.670 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:09.671 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:09.671 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:09.671 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:09.671 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: Deploying daemon mds.h on smithi102 2024-09-10T07:47:09.671 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:09 smithi073 ceph-mon[30850]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.749+0000 7fd222144640 1 -- 172.21.15.73:0/3322184342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c102790 msgr2=0x7fd21c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.749+0000 7fd222144640 1 --2- 172.21.15.73:0/3322184342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c102790 0x7fd21c1067e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd210009900 tx=0x7fd21002a410 comp rx=0 tx=0).stop 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.750+0000 7fd222144640 1 -- 172.21.15.73:0/3322184342 shutdown_connections 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.750+0000 7fd222144640 1 --2- 172.21.15.73:0/3322184342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21c106f10 0x7fd21c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.750+0000 7fd222144640 1 --2- 172.21.15.73:0/3322184342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c102790 0x7fd21c1067e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.750+0000 7fd222144640 1 --2- 172.21.15.73:0/3322184342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd21c101de0 0x7fd21c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.750+0000 7fd222144640 1 -- 172.21.15.73:0/3322184342 >> 172.21.15.73:0/3322184342 conn(0x7fd21c0fd8c0 msgr2=0x7fd21c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.750+0000 7fd222144640 1 -- 172.21.15.73:0/3322184342 shutdown_connections 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.750+0000 7fd222144640 1 -- 172.21.15.73:0/3322184342 wait complete. 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.750+0000 7fd222144640 1 Processor -- start 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.750+0000 7fd222144640 1 -- start start 2024-09-10T07:47:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd222144640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd21c101de0 0x7fd21c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd222144640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21c102790 0x7fd21c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd222144640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c106f10 0x7fd21c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd222144640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c111f70 con 0x7fd21c106f10 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd222144640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c111df0 con 0x7fd21c101de0 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd222144640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c1120f0 con 0x7fd21c102790 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c106f10 0x7fd21c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c106f10 0x7fd21c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54076/0 (socket says 172.21.15.73:54076) 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21bfff640 1 -- 172.21.15.73:0/3997301349 learned_addr learned my addr 172.21.15.73:0/3997301349 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21affd640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21c102790 0x7fd21c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21b7fe640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd21c101de0 0x7fd21c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21bfff640 1 -- 172.21.15.73:0/3997301349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21c102790 msgr2=0x7fd21c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21bfff640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21c102790 0x7fd21c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21bfff640 1 -- 172.21.15.73:0/3997301349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd21c101de0 msgr2=0x7fd21c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21bfff640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd21c101de0 0x7fd21c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21bfff640 1 -- 172.21.15.73:0/3997301349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c19d3d0 con 0x7fd21c106f10 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd21bfff640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c106f10 0x7fd21c19ccf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d750 tx=0x7fd21400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd218ff9640 1 -- 172.21.15.73:0/3997301349 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214017070 con 0x7fd21c106f10 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c19d6c0 con 0x7fd21c106f10 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd218ff9640 1 -- 172.21.15.73:0/3997301349 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd214005500 con 0x7fd21c106f10 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd218ff9640 1 -- 172.21.15.73:0/3997301349 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214004d90 con 0x7fd21c106f10 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.751+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c1a4fa0 con 0x7fd21c106f10 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.753+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c1021c0 con 0x7fd21c106f10 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.754+0000 7fd218ff9640 1 -- 172.21.15.73:0/3997301349 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd214004f30 con 0x7fd21c106f10 2024-09-10T07:47:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.754+0000 7fd218ff9640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd2040a2b80 0x7fd2040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:09.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.754+0000 7fd21b7fe640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd2040a2b80 0x7fd2040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:09.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.754+0000 7fd218ff9640 1 -- 172.21.15.73:0/3997301349 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd2140ce400 con 0x7fd21c106f10 2024-09-10T07:47:09.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.755+0000 7fd21b7fe640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd2040a2b80 0x7fd2040a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd20c005fd0 tx=0x7fd20c009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:09.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.758+0000 7fd218ff9640 1 -- 172.21.15.73:0/3997301349 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd21409b1b0 con 0x7fd21c106f10 2024-09-10T07:47:09.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.159:6836/1843594994,v1:172.21.15.159:6837/1843594994] up:boot 2024-09-10T07:47:09.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: fsmap 7 up:standby 2024-09-10T07:47:09.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T07:47:09.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:09.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:09.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:09.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:09.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:09.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:09.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: Deploying daemon mds.h on smithi102 2024-09-10T07:47:09.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:09 smithi159 ceph-mon[35522]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:09.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.960+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd21c02d7c0 con 0x7fd21c106f10 2024-09-10T07:47:09.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.960+0000 7fd218ff9640 1 -- 172.21.15.73:0/3997301349 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7fd21409f4b0 con 0x7fd21c106f10 2024-09-10T07:47:09.960 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:09.960 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-10T07:47:08:465424+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T07:47:09.960 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd2040a2b80 msgr2=0x7fd2040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd2040a2b80 0x7fd2040a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd20c005fd0 tx=0x7fd20c009760 comp rx=0 tx=0).stop 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c106f10 msgr2=0x7fd21c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c106f10 0x7fd21c19ccf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d750 tx=0x7fd21400dc10 comp rx=0 tx=0).stop 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 shutdown_connections 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd2040a2b80 0x7fd2040a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c106f10 0x7fd21c19ccf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21c102790 0x7fd21c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 --2- 172.21.15.73:0/3997301349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd21c101de0 0x7fd21c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 >> 172.21.15.73:0/3997301349 conn(0x7fd21c0fd8c0 msgr2=0x7fd21c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 shutdown_connections 2024-09-10T07:47:09.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:09.963+0000 7fd222144640 1 -- 172.21.15.73:0/3997301349 wait complete. 2024-09-10T07:47:10.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:10 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3997301349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:10.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:10 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3997301349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:10.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:10 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3997301349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:11.376 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 07:47:11 smithi102 systemd[1]: Started Ceph mds.h for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:47:11.835 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:11 smithi159 ceph-mon[35522]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:11.836 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:11.836 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:11.836 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:11.836 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:11.836 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:11.836 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:11 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:11.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:11 smithi102 ceph-mon[35514]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:11.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:11.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:11.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:11.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:11.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:11.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:11 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:11 smithi073 ceph-mon[30850]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:11.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:11.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:11.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:11 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:12.632 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:47:12.845 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:12 smithi159 ceph-mon[35522]: Deploying daemon mds.i on smithi159 2024-09-10T07:47:12.845 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:12 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.102:6836/801459300,v1:172.21.15.102:6837/801459300] up:boot 2024-09-10T07:47:12.845 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:12 smithi159 ceph-mon[35522]: fsmap 8 up:standby 2024-09-10T07:47:12.845 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:12 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T07:47:12.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:12 smithi102 ceph-mon[35514]: Deploying daemon mds.i on smithi159 2024-09-10T07:47:12.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:12 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.102:6836/801459300,v1:172.21.15.102:6837/801459300] up:boot 2024-09-10T07:47:12.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:12 smithi102 ceph-mon[35514]: fsmap 8 up:standby 2024-09-10T07:47:12.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:12 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T07:47:12.893 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:12.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:12 smithi073 ceph-mon[30850]: Deploying daemon mds.i on smithi159 2024-09-10T07:47:12.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:12 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.102:6836/801459300,v1:172.21.15.102:6837/801459300] up:boot 2024-09-10T07:47:12.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:12 smithi073 ceph-mon[30850]: fsmap 8 up:standby 2024-09-10T07:47:12.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:12 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T07:47:13.157 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 07:47:13 smithi159 systemd[1]: Starting Ceph mds.i for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:47:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.376+0000 7f318bb81640 1 -- 172.21.15.73:0/662528556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184100b30 msgr2=0x7f3184100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.376+0000 7f318bb81640 1 --2- 172.21.15.73:0/662528556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184100b30 0x7f3184100f10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3174009900 tx=0x7f317402a470 comp rx=0 tx=0).stop 2024-09-10T07:47:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.376+0000 7f318bb81640 1 -- 172.21.15.73:0/662528556 shutdown_connections 2024-09-10T07:47:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.376+0000 7f318bb81640 1 --2- 172.21.15.73:0/662528556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3184105f40 0x7f31841063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.376+0000 7f318bb81640 1 --2- 172.21.15.73:0/662528556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3184101450 0x7f3184105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.376+0000 7f318bb81640 1 --2- 172.21.15.73:0/662528556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184100b30 0x7f3184100f10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.376+0000 7f318bb81640 1 -- 172.21.15.73:0/662528556 >> 172.21.15.73:0/662528556 conn(0x7f31840fc7a0 msgr2=0x7f31840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.376+0000 7f318bb81640 1 -- 172.21.15.73:0/662528556 shutdown_connections 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.376+0000 7f318bb81640 1 -- 172.21.15.73:0/662528556 wait complete. 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318bb81640 1 Processor -- start 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318bb81640 1 -- start start 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318bb81640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3184100b30 0x7f31841a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318bb81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3184101450 0x7f31841a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318bb81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184105f40 0x7f318419e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318bb81640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f31841185c0 con 0x7f3184105f40 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318bb81640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3184118440 con 0x7f3184101450 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318bb81640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3184118740 con 0x7f3184100b30 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318a11e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184105f40 0x7f318419e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318a11e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184105f40 0x7f318419e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53170/0 (socket says 172.21.15.73:53170) 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318a11e640 1 -- 172.21.15.73:0/1767287705 learned_addr learned my addr 172.21.15.73:0/1767287705 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318991d640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3184100b30 0x7f31841a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318a11e640 1 -- 172.21.15.73:0/1767287705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3184100b30 msgr2=0x7f31841a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318a11e640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3184100b30 0x7f31841a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318a11e640 1 -- 172.21.15.73:0/1767287705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3184101450 msgr2=0x7f31841a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318911c640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3184101450 0x7f31841a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318a11e640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3184101450 0x7f31841a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318a11e640 1 -- 172.21.15.73:0/1767287705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318419f080 con 0x7f3184105f40 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318911c640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3184101450 0x7f31841a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.377+0000 7f318a11e640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184105f40 0x7f318419e950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f317c009fd0 tx=0x7f317c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.378+0000 7f317affd640 1 -- 172.21.15.73:0/1767287705 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c017070 con 0x7f3184105f40 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.378+0000 7f317affd640 1 -- 172.21.15.73:0/1767287705 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f317c003e50 con 0x7f3184105f40 2024-09-10T07:47:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.378+0000 7f317affd640 1 -- 172.21.15.73:0/1767287705 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c0106c0 con 0x7f3184105f40 2024-09-10T07:47:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.378+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318419f370 con 0x7f3184105f40 2024-09-10T07:47:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.378+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31841ab660 con 0x7f3184105f40 2024-09-10T07:47:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.379+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3184105920 con 0x7f3184105f40 2024-09-10T07:47:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.380+0000 7f317affd640 1 -- 172.21.15.73:0/1767287705 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f317c003970 con 0x7f3184105f40 2024-09-10T07:47:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.380+0000 7f317affd640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31700a2c00 0x7f31700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.381+0000 7f318991d640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31700a2c00 0x7f31700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.381+0000 7f317affd640 1 -- 172.21.15.73:0/1767287705 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f317c0ce890 con 0x7f3184105f40 2024-09-10T07:47:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.381+0000 7f318991d640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31700a2c00 0x7f31700a50c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f318419fa90 tx=0x7f31740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.384+0000 7f317affd640 1 -- 172.21.15.73:0/1767287705 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f317c09bd10 con 0x7f3184105f40 2024-09-10T07:47:13.495 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 07:47:13 smithi159 podman[66107]: 2024-09-10 07:47:13.145107379 +0000 UTC m=+0.015737301 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:47:13.495 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 07:47:13 smithi159 podman[66107]: 2024-09-10 07:47:13.258474732 +0000 UTC m=+0.129104644 container create 812aef7b875d0e68c269b283f4a895b2ee0ec63450251de6d832b365d73a16c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-i, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T07:47:13.496 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 07:47:13 smithi159 podman[66107]: 2024-09-10 07:47:13.469532737 +0000 UTC m=+0.340162649 container init 812aef7b875d0e68c269b283f4a895b2ee0ec63450251de6d832b365d73a16c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T07:47:13.496 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 07:47:13 smithi159 podman[66107]: 2024-09-10 07:47:13.47231551 +0000 UTC m=+0.342945423 container start 812aef7b875d0e68c269b283f4a895b2ee0ec63450251de6d832b365d73a16c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T07:47:13.496 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 07:47:13 smithi159 ceph-mds[66127]: -- 172.21.15.159:0/3350831909 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561decb17860 con 0x561decaf5400 2024-09-10T07:47:13.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.586+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31841ab950 con 0x7f3184105f40 2024-09-10T07:47:13.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.587+0000 7f317affd640 1 -- 172.21.15.73:0/1767287705 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8049 (secure 0 0 0) 0x7f317c09b610 con 0x7f3184105f40 2024-09-10T07:47:13.586 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:13.587 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"btime":"2024-09-10T07:47:13:547452+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T07:47:13.587 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 10 2024-09-10T07:47:13.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31700a2c00 msgr2=0x7f31700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:13.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31700a2c00 0x7f31700a50c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f318419fa90 tx=0x7f31740058d0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184105f40 msgr2=0x7f318419e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184105f40 0x7f318419e950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f317c009fd0 tx=0x7f317c00b260 comp rx=0 tx=0).stop 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 shutdown_connections 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31700a2c00 0x7f31700a50c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184105f40 0x7f318419e950 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3184101450 0x7f31841a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 --2- 172.21.15.73:0/1767287705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3184100b30 0x7f31841a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 >> 172.21.15.73:0/1767287705 conn(0x7f31840fc7a0 msgr2=0x7f31841038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 shutdown_connections 2024-09-10T07:47:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:13.589+0000 7f318bb81640 1 -- 172.21.15.73:0/1767287705 wait complete. 2024-09-10T07:47:13.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:13 smithi102 ceph-mon[35514]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:13.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:13 smithi159 ceph-mon[35522]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:13.909 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 07:47:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-i[66123]: starting mds.i at 2024-09-10T07:47:13.909 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 07:47:13 smithi159 bash[66107]: 812aef7b875d0e68c269b283f4a895b2ee0ec63450251de6d832b365d73a16c8 2024-09-10T07:47:13.910 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 07:47:13 smithi159 systemd[1]: Started Ceph mds.i for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:47:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:13 smithi073 ceph-mon[30850]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:14.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.159:6838/2574665327,v1:172.21.15.159:6839/2574665327] up:boot 2024-09-10T07:47:14.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: fsmap 9 up:standby 2024-09-10T07:47:14.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T07:47:14.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1767287705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:14.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:14.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:14.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:14.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:14.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:14.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:14.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:14 smithi073 ceph-mon[30850]: Deploying daemon mds.g on smithi073 2024-09-10T07:47:14.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.159:6838/2574665327,v1:172.21.15.159:6839/2574665327] up:boot 2024-09-10T07:47:14.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: fsmap 9 up:standby 2024-09-10T07:47:14.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T07:47:14.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1767287705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:14.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:14.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:14.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:14.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:14.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:14.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:14.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:14 smithi102 ceph-mon[35514]: Deploying daemon mds.g on smithi073 2024-09-10T07:47:14.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.159:6838/2574665327,v1:172.21.15.159:6839/2574665327] up:boot 2024-09-10T07:47:14.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: fsmap 9 up:standby 2024-09-10T07:47:14.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T07:47:14.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1767287705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:14.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:14.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:14.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:14.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:14.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:14.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:14.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:14 smithi159 ceph-mon[35522]: Deploying daemon mds.g on smithi073 2024-09-10T07:47:15.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:15 smithi073 ceph-mon[30850]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:15.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:15 smithi159 ceph-mon[35522]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:15.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:15 smithi102 ceph-mon[35514]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:16.169 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 07:47:15 smithi073 systemd[1]: Starting Ceph mds.g for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:47:16.279 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:47:16.430 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 07:47:16 smithi073 podman[72512]: 2024-09-10 07:47:16.072459263 +0000 UTC m=+0.015707950 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:47:16.430 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 07:47:16 smithi073 podman[72512]: 2024-09-10 07:47:16.20326331 +0000 UTC m=+0.146511986 container create 759da43ef5ecdbc79535dbc905f7c91037265a65a7012dd712619685dcae35b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T07:47:16.430 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 07:47:16 smithi073 podman[72512]: 2024-09-10 07:47:16.430857462 +0000 UTC m=+0.374106139 container init 759da43ef5ecdbc79535dbc905f7c91037265a65a7012dd712619685dcae35b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T07:47:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:16.722 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 07:47:16 smithi073 podman[72512]: 2024-09-10 07:47:16.434244877 +0000 UTC m=+0.377493557 container start 759da43ef5ecdbc79535dbc905f7c91037265a65a7012dd712619685dcae35b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T07:47:16.722 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 07:47:16 smithi073 ceph-mds[72548]: -- 172.21.15.73:0/2978157281 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558a74d57860 con 0x558a74d34800 2024-09-10T07:47:16.722 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 07:47:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-g[72544]: starting mds.g at 2024-09-10T07:47:16.722 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 07:47:16 smithi073 bash[72512]: 759da43ef5ecdbc79535dbc905f7c91037265a65a7012dd712619685dcae35b1 2024-09-10T07:47:16.722 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 07:47:16 smithi073 systemd[1]: Started Ceph mds.g for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:47:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.080+0000 7f0ffea3d640 1 -- 172.21.15.73:0/4173817818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff8103660 msgr2=0x7f0ff810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.080+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/4173817818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff8103660 0x7f0ff810bb50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009900 tx=0x7f0fec02a480 comp rx=0 tx=0).stop 2024-09-10T07:47:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.081+0000 7f0ffea3d640 1 -- 172.21.15.73:0/4173817818 shutdown_connections 2024-09-10T07:47:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.081+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/4173817818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff810c170 0x7f0ff810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.081+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/4173817818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff8103660 0x7f0ff810bb50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.081+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/4173817818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff8102d40 0x7f0ff8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.081+0000 7f0ffea3d640 1 -- 172.21.15.73:0/4173817818 >> 172.21.15.73:0/4173817818 conn(0x7f0ff80fc7a0 msgr2=0x7f0ff80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.081+0000 7f0ffea3d640 1 -- 172.21.15.73:0/4173817818 shutdown_connections 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.081+0000 7f0ffea3d640 1 -- 172.21.15.73:0/4173817818 wait complete. 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.081+0000 7f0ffea3d640 1 Processor -- start 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.081+0000 7f0ffea3d640 1 -- start start 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffea3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff8102d40 0x7f0ff8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffea3d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff8103660 0x7f0ff8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffea3d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff810c170 0x7f0ff819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffea3d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8111f70 con 0x7f0ff810c170 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffea3d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8111df0 con 0x7f0ff8103660 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffea3d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff81120f0 con 0x7f0ff8102d40 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffcfda640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff810c170 0x7f0ff819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffcfda640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff810c170 0x7f0ff819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53202/0 (socket says 172.21.15.73:53202) 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffcfda640 1 -- 172.21.15.73:0/3954810205 learned_addr learned my addr 172.21.15.73:0/3954810205 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ff7fff640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff8102d40 0x7f0ff8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffcfda640 1 -- 172.21.15.73:0/3954810205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff8102d40 msgr2=0x7f0ff8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffcfda640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff8102d40 0x7f0ff8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ff77fe640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff8103660 0x7f0ff8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffcfda640 1 -- 172.21.15.73:0/3954810205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff8103660 msgr2=0x7f0ff8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffcfda640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff8103660 0x7f0ff8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffcfda640 1 -- 172.21.15.73:0/3954810205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff819d400 con 0x7f0ff810c170 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ff77fe640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff8103660 0x7f0ff8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffcfda640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff810c170 0x7f0ff819cd20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000eaa0 tx=0x7f0ff000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ff57fa640 1 -- 172.21.15.73:0/3954810205 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000cdb0 con 0x7f0ff810c170 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ff57fa640 1 -- 172.21.15.73:0/3954810205 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ff0005020 con 0x7f0ff810c170 2024-09-10T07:47:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ff57fa640 1 -- 172.21.15.73:0/3954810205 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00116b0 con 0x7f0ff810c170 2024-09-10T07:47:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff819d6f0 con 0x7f0ff810c170 2024-09-10T07:47:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.082+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff81a4fd0 con 0x7f0ff810c170 2024-09-10T07:47:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.084+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff8103120 con 0x7f0ff810c170 2024-09-10T07:47:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.084+0000 7f0ff57fa640 1 -- 172.21.15.73:0/3954810205 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0ff0005560 con 0x7f0ff810c170 2024-09-10T07:47:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.085+0000 7f0ff57fa640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0fe00a2c00 0x7f0fe00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.086+0000 7f0ff7fff640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0fe00a2c00 0x7f0fe00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.086+0000 7f0ff57fa640 1 -- 172.21.15.73:0/3954810205 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f0ff00cecd0 con 0x7f0ff810c170 2024-09-10T07:47:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.086+0000 7f0ff7fff640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0fe00a2c00 0x7f0fe00a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8005d00 tx=0x7f0fe800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.090+0000 7f0ff57fa640 1 -- 172.21.15.73:0/3954810205 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ff0016030 con 0x7f0ff810c170 2024-09-10T07:47:17.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.300+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ff81a52c0 con 0x7f0ff810c170 2024-09-10T07:47:17.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.300+0000 7f0ff57fa640 1 -- 172.21.15.73:0/3954810205 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f0ff009c0d0 con 0x7f0ff810c170 2024-09-10T07:47:17.300 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:17.300 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"btime":"2024-09-10T07:47:16:560017+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T07:47:17.300 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2024-09-10T07:47:17.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.302+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0fe00a2c00 msgr2=0x7f0fe00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:17.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.302+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0fe00a2c00 0x7f0fe00a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8005d00 tx=0x7f0fe800b410 comp rx=0 tx=0).stop 2024-09-10T07:47:17.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.302+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff810c170 msgr2=0x7f0ff819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:17.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.302+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff810c170 0x7f0ff819cd20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000eaa0 tx=0x7f0ff000ef60 comp rx=0 tx=0).stop 2024-09-10T07:47:17.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.303+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 shutdown_connections 2024-09-10T07:47:17.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.303+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0fe00a2c00 0x7f0fe00a50c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:17.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.303+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ff810c170 0x7f0ff819cd20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:17.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.303+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff8103660 0x7f0ff8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:17.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.303+0000 7f0ffea3d640 1 --2- 172.21.15.73:0/3954810205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff8102d40 0x7f0ff8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:17.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.303+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 >> 172.21.15.73:0/3954810205 conn(0x7f0ff80fc7a0 msgr2=0x7f0ff80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:17.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.303+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 shutdown_connections 2024-09-10T07:47:17.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:17.303+0000 7f0ffea3d640 1 -- 172.21.15.73:0/3954810205 wait complete. 2024-09-10T07:47:17.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.73:6838/3892628797,v1:172.21.15.73:6839/3892628797] up:boot 2024-09-10T07:47:17.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: fsmap 10 up:standby 2024-09-10T07:47:17.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T07:47:17.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:17.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:17.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:17.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:17.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:17.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:17.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: Deploying daemon mds.a on smithi073 2024-09-10T07:47:17.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:17.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:17 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3954810205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:17.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.73:6838/3892628797,v1:172.21.15.73:6839/3892628797] up:boot 2024-09-10T07:47:17.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: fsmap 10 up:standby 2024-09-10T07:47:17.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T07:47:17.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:17.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:17.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:17.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:17.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:17.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:17.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: Deploying daemon mds.a on smithi073 2024-09-10T07:47:17.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:17.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:17 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3954810205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:17.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.73:6838/3892628797,v1:172.21.15.73:6839/3892628797] up:boot 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: fsmap 10 up:standby 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: Deploying daemon mds.a on smithi073 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:17.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:17 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3954810205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:19.472 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 07:47:19 smithi073 systemd[1]: Starting Ceph mds.a for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:47:19.817 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:19 smithi073 ceph-mon[30850]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:19.817 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 07:47:19 smithi073 podman[72922]: 2024-09-10 07:47:19.462859848 +0000 UTC m=+0.016207351 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:47:19.817 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 07:47:19 smithi073 podman[72922]: 2024-09-10 07:47:19.582391714 +0000 UTC m=+0.135739216 container create 5e538020fa47b11f440b850582174ba3683980ee088608f6fb82a1c849b5bf53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T07:47:19.817 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 07:47:19 smithi073 podman[72922]: 2024-09-10 07:47:19.818620428 +0000 UTC m=+0.371967931 container init 5e538020fa47b11f440b850582174ba3683980ee088608f6fb82a1c849b5bf53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T07:47:20.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:47:20.083 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 07:47:19 smithi073 podman[72922]: 2024-09-10 07:47:19.821695585 +0000 UTC m=+0.375043099 container start 5e538020fa47b11f440b850582174ba3683980ee088608f6fb82a1c849b5bf53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:47:20.084 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 07:47:19 smithi073 ceph-mds[72942]: -- 172.21.15.73:0/4183156670 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b1c5905860 con 0x55b1c58e3400 2024-09-10T07:47:20.084 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 07:47:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-a[72938]: starting mds.a at 2024-09-10T07:47:20.084 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 07:47:19 smithi073 bash[72922]: 5e538020fa47b11f440b850582174ba3683980ee088608f6fb82a1c849b5bf53 2024-09-10T07:47:20.084 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 07:47:19 smithi073 systemd[1]: Started Ceph mds.a for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:47:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:19 smithi102 ceph-mon[35514]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:20.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:19 smithi159 ceph-mon[35522]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:20.308 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.793+0000 7f9652d68640 1 -- 172.21.15.73:0/3326220893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 msgr2=0x7f964c101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.793+0000 7f9652d68640 1 --2- 172.21.15.73:0/3326220893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 0x7f964c101820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f963c009900 tx=0x7f963c02a410 comp rx=0 tx=0).stop 2024-09-10T07:47:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.793+0000 7f9652d68640 1 -- 172.21.15.73:0/3326220893 shutdown_connections 2024-09-10T07:47:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.793+0000 7f9652d68640 1 --2- 172.21.15.73:0/3326220893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f964c106050 0x7f964c10dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.793+0000 7f9652d68640 1 --2- 172.21.15.73:0/3326220893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f964c101df0 0x7f964c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.793+0000 7f9652d68640 1 --2- 172.21.15.73:0/3326220893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 0x7f964c101820 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.793+0000 7f9652d68640 1 -- 172.21.15.73:0/3326220893 >> 172.21.15.73:0/3326220893 conn(0x7f964c077210 msgr2=0x7f964c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.793+0000 7f9652d68640 1 -- 172.21.15.73:0/3326220893 shutdown_connections 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.793+0000 7f9652d68640 1 -- 172.21.15.73:0/3326220893 wait complete. 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9652d68640 1 Processor -- start 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9652d68640 1 -- start start 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9652d68640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 0x7f964c0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9652d68640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f964c101df0 0x7f964c0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9652d68640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f964c106050 0x7f964c0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9652d68640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f964c111080 con 0x7f964c101440 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9652d68640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f964c110f00 con 0x7f964c101df0 2024-09-10T07:47:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9652d68640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f964c111200 con 0x7f964c106050 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9650b04640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 0x7f964c0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9650b04640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 0x7f964c0fc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55794/0 (socket says 172.21.15.73:55794) 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9650b04640 1 -- 172.21.15.73:0/1262606144 learned_addr learned my addr 172.21.15.73:0/1262606144 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f964bfff640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f964c101df0 0x7f964c0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9651305640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f964c106050 0x7f964c0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9650b04640 1 -- 172.21.15.73:0/1262606144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f964c106050 msgr2=0x7f964c0fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9650b04640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f964c106050 0x7f964c0fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9650b04640 1 -- 172.21.15.73:0/1262606144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f964c101df0 msgr2=0x7f964c0fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9650b04640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f964c101df0 0x7f964c0fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9650b04640 1 -- 172.21.15.73:0/1262606144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c1a6bb0 con 0x7f964c101440 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.794+0000 7f9651305640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f964c106050 0x7f964c0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.795+0000 7f9650b04640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 0x7f964c0fc690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f963c006010 tx=0x7f963c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.795+0000 7f9649ffb640 1 -- 172.21.15.73:0/1262606144 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c03f030 con 0x7f964c101440 2024-09-10T07:47:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.795+0000 7f9649ffb640 1 -- 172.21.15.73:0/1262606144 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f963c003ce0 con 0x7f964c101440 2024-09-10T07:47:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.795+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c1a6e40 con 0x7f964c101440 2024-09-10T07:47:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.795+0000 7f9649ffb640 1 -- 172.21.15.73:0/1262606144 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c035070 con 0x7f964c101440 2024-09-10T07:47:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.795+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c1a7290 con 0x7f964c101440 2024-09-10T07:47:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.796+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964c101820 con 0x7f964c101440 2024-09-10T07:47:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.798+0000 7f9649ffb640 1 -- 172.21.15.73:0/1262606144 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f963c042030 con 0x7f964c101440 2024-09-10T07:47:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.799+0000 7f9649ffb640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96380a2b80 0x7f96380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.799+0000 7f964bfff640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96380a2b80 0x7f96380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.799+0000 7f9649ffb640 1 -- 172.21.15.73:0/1262606144 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f963c0ef340 con 0x7f964c101440 2024-09-10T07:47:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.799+0000 7f964bfff640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96380a2b80 0x7f96380a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f964c0fe120 tx=0x7f963400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:20.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:20.802+0000 7f9649ffb640 1 -- 172.21.15.73:0/1262606144 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f963c0bc800 con 0x7f964c101440 2024-09-10T07:47:21.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.003+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f964c0fdbc0 con 0x7f964c101440 2024-09-10T07:47:21.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.004+0000 7f9649ffb640 1 -- 172.21.15.73:0/1262606144 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7f963c0bc100 con 0x7f964c101440 2024-09-10T07:47:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:21.003 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":12,"btime":"2024-09-10T07:47:20:711035+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T07:47:21.004 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 12 2024-09-10T07:47:21.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96380a2b80 msgr2=0x7f96380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:21.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96380a2b80 0x7f96380a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f964c0fe120 tx=0x7f963400b390 comp rx=0 tx=0).stop 2024-09-10T07:47:21.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 msgr2=0x7f964c0fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:21.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 0x7f964c0fc690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f963c006010 tx=0x7f963c0042f0 comp rx=0 tx=0).stop 2024-09-10T07:47:21.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 shutdown_connections 2024-09-10T07:47:21.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96380a2b80 0x7f96380a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:21.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f964c106050 0x7f964c0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:21.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f964c101df0 0x7f964c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:21.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 --2- 172.21.15.73:0/1262606144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964c101440 0x7f964c0fc690 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:21.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 >> 172.21.15.73:0/1262606144 conn(0x7f964c077210 msgr2=0x7f964c104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:21.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 shutdown_connections 2024-09-10T07:47:21.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:21.006+0000 7f9652d68640 1 -- 172.21.15.73:0/1262606144 wait complete. 2024-09-10T07:47:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:21.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:21.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: Deploying daemon mds.b on smithi102 2024-09-10T07:47:21.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:21.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.73:6840/1022312425,v1:172.21.15.73:6841/1022312425] up:boot 2024-09-10T07:47:21.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: fsmap 11 up:standby 2024-09-10T07:47:21.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T07:47:21.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:21 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1262606144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:21.292 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:21.292 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:21.292 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:21.292 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:21.292 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:21.292 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:21.293 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: Deploying daemon mds.b on smithi102 2024-09-10T07:47:21.293 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:21.293 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.73:6840/1022312425,v1:172.21.15.73:6841/1022312425] up:boot 2024-09-10T07:47:21.293 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: fsmap 11 up:standby 2024-09-10T07:47:21.293 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T07:47:21.293 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:21 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1262606144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T07:47:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T07:47:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: Deploying daemon mds.b on smithi102 2024-09-10T07:47:21.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:21.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.73:6840/1022312425,v1:172.21.15.73:6841/1022312425] up:boot 2024-09-10T07:47:21.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: fsmap 11 up:standby 2024-09-10T07:47:21.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T07:47:21.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:21 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1262606144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:22.287 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:22 smithi102 systemd[1]: Starting Ceph mds.b for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:47:22.540 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:22 smithi102 podman[65340]: 2024-09-10 07:47:22.190760164 +0000 UTC m=+0.015648474 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T07:47:22.540 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:22 smithi102 podman[65340]: 2024-09-10 07:47:22.303511172 +0000 UTC m=+0.128399470 container create 02686c4ab49080e2b23c27100ab1f548638bdbe8389fe139b9c1777b43c11cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T07:47:22.540 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:22 smithi102 podman[65340]: 2024-09-10 07:47:22.514559567 +0000 UTC m=+0.339447861 container init 02686c4ab49080e2b23c27100ab1f548638bdbe8389fe139b9c1777b43c11cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T07:47:22.540 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:22 smithi102 podman[65340]: 2024-09-10 07:47:22.517284054 +0000 UTC m=+0.342172350 container start 02686c4ab49080e2b23c27100ab1f548638bdbe8389fe139b9c1777b43c11cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:47:22.540 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:22 smithi102 ceph-mds[65359]: -- 172.21.15.102:0/2120004789 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558bfffdb860 con 0x558bfffb9400 2024-09-10T07:47:22.876 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b[65355]: starting mds.b at 2024-09-10T07:47:22.876 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:22 smithi102 bash[65340]: 02686c4ab49080e2b23c27100ab1f548638bdbe8389fe139b9c1777b43c11cd9 2024-09-10T07:47:22.876 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:22 smithi102 systemd[1]: Started Ceph mds.b for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T07:47:23.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:47:23.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] up:boot 2024-09-10T07:47:23.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: fsmap 12 up:standby 2024-09-10T07:47:23.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T07:47:23.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:23.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:23 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] up:boot 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: fsmap 12 up:standby 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:23 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:47:23.777 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] up:boot 2024-09-10T07:47:23.778 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: fsmap 12 up:standby 2024-09-10T07:47:23.778 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T07:47:23.778 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:23.778 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.778 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.778 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.778 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.778 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:23.778 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:23 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:47:23.909 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:24.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.396+0000 7f31b79e4640 1 -- 172.21.15.73:0/3857033746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102ef0 msgr2=0x7f31b010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:24.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.396+0000 7f31b79e4640 1 --2- 172.21.15.73:0/3857033746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102ef0 0x7f31b010da40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009900 tx=0x7f31a002a480 comp rx=0 tx=0).stop 2024-09-10T07:47:24.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.396+0000 7f31b79e4640 1 -- 172.21.15.73:0/3857033746 shutdown_connections 2024-09-10T07:47:24.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.396+0000 7f31b79e4640 1 --2- 172.21.15.73:0/3857033746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102ef0 0x7f31b010da40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.396+0000 7f31b79e4640 1 --2- 172.21.15.73:0/3857033746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31b0102570 0x7f31b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.396+0000 7f31b79e4640 1 --2- 172.21.15.73:0/3857033746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31b0100e20 0x7f31b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.396+0000 7f31b79e4640 1 -- 172.21.15.73:0/3857033746 >> 172.21.15.73:0/3857033746 conn(0x7f31b00fc7d0 msgr2=0x7f31b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.396+0000 7f31b79e4640 1 -- 172.21.15.73:0/3857033746 shutdown_connections 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.396+0000 7f31b79e4640 1 -- 172.21.15.73:0/3857033746 wait complete. 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b79e4640 1 Processor -- start 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b79e4640 1 -- start start 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b79e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31b0100e20 0x7f31b00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b79e4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102570 0x7f31b00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b79e4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31b0102ef0 0x7f31b00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b79e4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f31b0110f80 con 0x7f31b0102570 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b79e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f31b0110e00 con 0x7f31b0100e20 2024-09-10T07:47:24.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b79e4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f31b0111100 con 0x7f31b0102ef0 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b4f7f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102570 0x7f31b00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b4f7f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102570 0x7f31b00fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55802/0 (socket says 172.21.15.73:55802) 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b4f7f640 1 -- 172.21.15.73:0/2735380482 learned_addr learned my addr 172.21.15.73:0/2735380482 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b5780640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31b0100e20 0x7f31b00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b5f81640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31b0102ef0 0x7f31b00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b4f7f640 1 -- 172.21.15.73:0/2735380482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31b0102ef0 msgr2=0x7f31b00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b4f7f640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31b0102ef0 0x7f31b00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b4f7f640 1 -- 172.21.15.73:0/2735380482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31b0100e20 msgr2=0x7f31b00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b4f7f640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31b0100e20 0x7f31b00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b4f7f640 1 -- 172.21.15.73:0/2735380482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b01a69c0 con 0x7f31b0102570 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.397+0000 7f31b4f7f640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102570 0x7f31b00fd1c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31a400d770 tx=0x7f31a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:24.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.398+0000 7f31ae7fc640 1 -- 172.21.15.73:0/2735380482 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4017070 con 0x7f31b0102570 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.398+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b01a6cb0 con 0x7f31b0102570 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.398+0000 7f31ae7fc640 1 -- 172.21.15.73:0/2735380482 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31a4005500 con 0x7f31b0102570 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.398+0000 7f31ae7fc640 1 -- 172.21.15.73:0/2735380482 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4004e00 con 0x7f31b0102570 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.398+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b01a71a0 con 0x7f31b0102570 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.399+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b0101200 con 0x7f31b0102570 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.400+0000 7f31ae7fc640 1 -- 172.21.15.73:0/2735380482 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f31a4004fa0 con 0x7f31b0102570 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.400+0000 7f31ae7fc640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31980a2b80 0x7f31980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.400+0000 7f31b5780640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31980a2b80 0x7f31980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.400+0000 7f31ae7fc640 1 -- 172.21.15.73:0/2735380482 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f31a40ce4c0 con 0x7f31b0102570 2024-09-10T07:47:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.401+0000 7f31b5780640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31980a2b80 0x7f31980a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31a8005fd0 tx=0x7f31a8009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:24.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.405+0000 7f31ae7fc640 1 -- 172.21.15.73:0/2735380482 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31a409b270 con 0x7f31b0102570 2024-09-10T07:47:24.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.625+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31b010a0a0 con 0x7f31b0102570 2024-09-10T07:47:24.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.626+0000 7f31ae7fc640 1 -- 172.21.15.73:0/2735380482 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7f31a409f570 con 0x7f31b0102570 2024-09-10T07:47:24.626 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:24.626 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"btime":"2024-09-10T07:47:22:596249+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/330469529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":330469529},{"type":"v1","addr":"172.21.15.102:6839","nonce":330469529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T07:47:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 13 2024-09-10T07:47:24.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31980a2b80 msgr2=0x7f31980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:24.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31980a2b80 0x7f31980a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31a8005fd0 tx=0x7f31a8009760 comp rx=0 tx=0).stop 2024-09-10T07:47:24.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102570 msgr2=0x7f31b00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:24.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102570 0x7f31b00fd1c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31a400d770 tx=0x7f31a400dc30 comp rx=0 tx=0).stop 2024-09-10T07:47:24.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 shutdown_connections 2024-09-10T07:47:24.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f31980a2b80 0x7f31980a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31b0102ef0 0x7f31b00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31b0102570 0x7f31b00fd1c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 --2- 172.21.15.73:0/2735380482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31b0100e20 0x7f31b00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 >> 172.21.15.73:0/2735380482 conn(0x7f31b00fc7d0 msgr2=0x7f31b006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 shutdown_connections 2024-09-10T07:47:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:24.629+0000 7f31b79e4640 1 -- 172.21.15.73:0/2735380482 wait complete. 2024-09-10T07:47:25.271 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2735380482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:25.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:47:25.273 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.273 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:25 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:47:25.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T07:47:25.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2735380482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:25.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:25.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.468 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.468 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:25.468 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:47:25.468 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.468 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:25 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:47:25.624 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.624 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2735380482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:25.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:25.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:25.626 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:47:25.626 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:25.626 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:25 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:47:26.199 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:26.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.735+0000 7ffb29147640 1 -- 172.21.15.73:0/2180379405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 msgr2=0x7ffb241029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:26.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.735+0000 7ffb29147640 1 --2- 172.21.15.73:0/2180379405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 0x7ffb241029b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009900 tx=0x7ffb0c02a480 comp rx=0 tx=0).stop 2024-09-10T07:47:26.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.735+0000 7ffb29147640 1 -- 172.21.15.73:0/2180379405 shutdown_connections 2024-09-10T07:47:26.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.735+0000 7ffb29147640 1 --2- 172.21.15.73:0/2180379405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb24102ef0 0x7ffb2410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:26.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.735+0000 7ffb29147640 1 --2- 172.21.15.73:0/2180379405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 0x7ffb241029b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:26.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.735+0000 7ffb29147640 1 --2- 172.21.15.73:0/2180379405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb24100e20 0x7ffb24101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:26.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.735+0000 7ffb29147640 1 -- 172.21.15.73:0/2180379405 >> 172.21.15.73:0/2180379405 conn(0x7ffb240fc7d0 msgr2=0x7ffb240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:26.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.735+0000 7ffb29147640 1 -- 172.21.15.73:0/2180379405 shutdown_connections 2024-09-10T07:47:26.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.735+0000 7ffb29147640 1 -- 172.21.15.73:0/2180379405 wait complete. 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.736+0000 7ffb29147640 1 Processor -- start 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.736+0000 7ffb29147640 1 -- start start 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb29147640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb24100e20 0x7ffb24198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb29147640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 0x7ffb24198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb29147640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb24102ef0 0x7ffb2419cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb29147640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffb24111020 con 0x7ffb24102570 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb29147640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb24110ea0 con 0x7ffb24102ef0 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb29147640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffb241111a0 con 0x7ffb24100e20 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 0x7ffb24198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 0x7ffb24198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55822/0 (socket says 172.21.15.73:55822) 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2259c640 1 -- 172.21.15.73:0/3196228795 learned_addr learned my addr 172.21.15.73:0/3196228795 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb22d9d640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb24100e20 0x7ffb24198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:26.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2359e640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb24102ef0 0x7ffb2419cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2259c640 1 -- 172.21.15.73:0/3196228795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb24100e20 msgr2=0x7ffb24198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2259c640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb24100e20 0x7ffb24198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2259c640 1 -- 172.21.15.73:0/3196228795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb24102ef0 msgr2=0x7ffb2419cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2259c640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb24102ef0 0x7ffb2419cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2259c640 1 -- 172.21.15.73:0/3196228795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2419d6c0 con 0x7ffb24102570 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb2259c640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 0x7ffb24198c50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c006010 tx=0x7ffb0c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb1bfff640 1 -- 172.21.15.73:0/3196228795 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c03f070 con 0x7ffb24102570 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2419d950 con 0x7ffb24102570 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb1bfff640 1 -- 172.21.15.73:0/3196228795 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb0c031e30 con 0x7ffb24102570 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb1bfff640 1 -- 172.21.15.73:0/3196228795 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c035030 con 0x7ffb24102570 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.737+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb241a5290 con 0x7ffb24102570 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.738+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb24101280 con 0x7ffb24102570 2024-09-10T07:47:26.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.740+0000 7ffb1bfff640 1 -- 172.21.15.73:0/3196228795 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffb0c042070 con 0x7ffb24102570 2024-09-10T07:47:26.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.740+0000 7ffb1bfff640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffb100a2b80 0x7ffb100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:26.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.741+0000 7ffb22d9d640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffb100a2b80 0x7ffb100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:26.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.741+0000 7ffb1bfff640 1 -- 172.21.15.73:0/3196228795 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ffb0c0efc40 con 0x7ffb24102570 2024-09-10T07:47:26.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.741+0000 7ffb22d9d640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffb100a2b80 0x7ffb100a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009990 tx=0x7ffb14009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:26.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.743+0000 7ffb1bfff640 1 -- 172.21.15.73:0/3196228795 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb0c0bd020 con 0x7ffb24102570 2024-09-10T07:47:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.949+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ffb2410a0a0 con 0x7ffb24102570 2024-09-10T07:47:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.949+0000 7ffb1bfff640 1 -- 172.21.15.73:0/3196228795 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7ffb0c0bc920 con 0x7ffb24102570 2024-09-10T07:47:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:26.949 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-10T07:47:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:47:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-10T07:47:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-10T07:47:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:47:26.949 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-10T07:47:26.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffb100a2b80 msgr2=0x7ffb100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:26.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffb100a2b80 0x7ffb100a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009990 tx=0x7ffb14009110 comp rx=0 tx=0).stop 2024-09-10T07:47:26.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 msgr2=0x7ffb24198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:26.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 0x7ffb24198c50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c006010 tx=0x7ffb0c003c80 comp rx=0 tx=0).stop 2024-09-10T07:47:26.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 shutdown_connections 2024-09-10T07:47:26.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffb100a2b80 0x7ffb100a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:26.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb24102ef0 0x7ffb2419cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:26.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb24102570 0x7ffb24198c50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:26.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 --2- 172.21.15.73:0/3196228795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb24100e20 0x7ffb24198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:26.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.952+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 >> 172.21.15.73:0/3196228795 conn(0x7ffb240fc7d0 msgr2=0x7ffb2406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:26.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.953+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 shutdown_connections 2024-09-10T07:47:26.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:26.953+0000 7ffb29147640 1 -- 172.21.15.73:0/3196228795 wait complete. 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3196228795' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:27.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:47:27.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.671 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:47:27.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:47:27.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:27.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3196228795' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T07:47:27.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:27.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:47:27.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3196228795' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:47:27.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:47:27.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:47:27.913 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:28.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.380+0000 7fe88a4bb640 1 -- 172.21.15.73:0/69855143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 msgr2=0x7fe8841067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.380+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/69855143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 0x7fe8841067e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe878009900 tx=0x7fe87802a410 comp rx=0 tx=0).stop 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 -- 172.21.15.73:0/69855143 shutdown_connections 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/69855143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884106f10 0x7fe88410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/69855143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 0x7fe8841067e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/69855143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe884101de0 0x7fe8841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 -- 172.21.15.73:0/69855143 >> 172.21.15.73:0/69855143 conn(0x7fe8840fd8c0 msgr2=0x7fe8840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 -- 172.21.15.73:0/69855143 shutdown_connections 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 -- 172.21.15.73:0/69855143 wait complete. 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 Processor -- start 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 -- start start 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe884101de0 0x7fe884198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 0x7fe8841989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884106f10 0x7fe88419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.381+0000 7fe88a4bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe884111f90 con 0x7fe884102790 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe88a4bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe884111e10 con 0x7fe884101de0 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe88a4bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe884112110 con 0x7fe884106f10 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 0x7fe8841989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 0x7fe8841989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55836/0 (socket says 172.21.15.73:55836) 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8837fe640 1 -- 172.21.15.73:0/22819015 learned_addr learned my addr 172.21.15.73:0/22819015 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe883fff640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe884101de0 0x7fe884198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe888a58640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884106f10 0x7fe88419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8837fe640 1 -- 172.21.15.73:0/22819015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884106f10 msgr2=0x7fe88419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8837fe640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884106f10 0x7fe88419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8837fe640 1 -- 172.21.15.73:0/22819015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe884101de0 msgr2=0x7fe884198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8837fe640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe884101de0 0x7fe884198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8837fe640 1 -- 172.21.15.73:0/22819015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88419d420 con 0x7fe884102790 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8837fe640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 0x7fe8841989b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe878006010 tx=0x7fe8780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8817fa640 1 -- 172.21.15.73:0/22819015 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87803f030 con 0x7fe884102790 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88419d6b0 con 0x7fe884102790 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8817fa640 1 -- 172.21.15.73:0/22819015 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe878003ce0 con 0x7fe884102790 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe8817fa640 1 -- 172.21.15.73:0/22819015 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878035070 con 0x7fe884102790 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.382+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8841a4ff0 con 0x7fe884102790 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.383+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8841032c0 con 0x7fe884102790 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.384+0000 7fe8817fa640 1 -- 172.21.15.73:0/22819015 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe878042030 con 0x7fe884102790 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.385+0000 7fe8817fa640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe86c0a2b80 0x7fe86c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.385+0000 7fe883fff640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe86c0a2b80 0x7fe86c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.386+0000 7fe8817fa640 1 -- 172.21.15.73:0/22819015 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fe8780ef310 con 0x7fe884102790 2024-09-10T07:47:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.386+0000 7fe883fff640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe86c0a2b80 0x7fe86c0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe874005fd0 tx=0x7fe874005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:28.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.390+0000 7fe8817fa640 1 -- 172.21.15.73:0/22819015 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8780bc7d0 con 0x7fe884102790 2024-09-10T07:47:28.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.556+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe88410a180 con 0x7fe884102790 2024-09-10T07:47:28.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.843+0000 7fe8817fa640 1 -- 172.21.15.73:0/22819015 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7fe8780bc0d0 con 0x7fe884102790 2024-09-10T07:47:28.843 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe86c0a2b80 msgr2=0x7fe86c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe86c0a2b80 0x7fe86c0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe874005fd0 tx=0x7fe874005850 comp rx=0 tx=0).stop 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 msgr2=0x7fe8841989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 0x7fe8841989b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe878006010 tx=0x7fe8780042f0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 shutdown_connections 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe86c0a2b80 0x7fe86c0a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884106f10 0x7fe88419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe884102790 0x7fe8841989b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 --2- 172.21.15.73:0/22819015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe884101de0 0x7fe884198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.845+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 >> 172.21.15.73:0/22819015 conn(0x7fe8840fd8c0 msgr2=0x7fe8840fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:28.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.846+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 shutdown_connections 2024-09-10T07:47:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:28.846+0000 7fe88a4bb640 1 -- 172.21.15.73:0/22819015 wait complete. 2024-09-10T07:47:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:28 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/22819015' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T07:47:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:28 smithi102 ceph-mon[35514]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:28 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/22819015' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T07:47:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:28 smithi159 ceph-mon[35522]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:29.167 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:28 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/22819015' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T07:47:29.167 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:28 smithi073 ceph-mon[30850]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:29.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:47:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:29 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/22819015' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T07:47:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:29 smithi102 ceph-mon[35514]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T07:47:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:29 smithi102 ceph-mon[35514]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T07:47:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:29 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/22819015' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T07:47:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:29 smithi159 ceph-mon[35522]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T07:47:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:29 smithi159 ceph-mon[35522]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T07:47:30.171 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:29 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/22819015' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T07:47:30.171 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:29 smithi073 ceph-mon[30850]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T07:47:30.171 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:29 smithi073 ceph-mon[30850]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T07:47:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.256+0000 7fe1231e5640 1 -- 172.21.15.73:0/3823428316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c100a80 msgr2=0x7fe11c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.256+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3823428316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c100a80 0x7fe11c100ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe110009930 tx=0x7fe11002a420 comp rx=0 tx=0).stop 2024-09-10T07:47:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.256+0000 7fe1231e5640 1 -- 172.21.15.73:0/3823428316 shutdown_connections 2024-09-10T07:47:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.256+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3823428316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe11c101420 0x7fe11c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.256+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3823428316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c100a80 0x7fe11c100ee0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.256+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3823428316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe11c106a80 0x7fe11c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.256+0000 7fe1231e5640 1 -- 172.21.15.73:0/3823428316 >> 172.21.15.73:0/3823428316 conn(0x7fe11c0fc7a0 msgr2=0x7fe11c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.256+0000 7fe1231e5640 1 -- 172.21.15.73:0/3823428316 shutdown_connections 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.256+0000 7fe1231e5640 1 -- 172.21.15.73:0/3823428316 wait complete. 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe1231e5640 1 Processor -- start 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe1231e5640 1 -- start start 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe1231e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe11c100a80 0x7fe11c197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe1231e5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe11c101420 0x7fe11c1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe1231e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c106a80 0x7fe11c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe1231e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c110e80 con 0x7fe11c106a80 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe1231e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c110d00 con 0x7fe11c100a80 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe1231e5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c111000 con 0x7fe11c101420 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe121782640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c106a80 0x7fe11c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe121782640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c106a80 0x7fe11c19bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60796/0 (socket says 172.21.15.73:60796) 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.257+0000 7fe121782640 1 -- 172.21.15.73:0/3341378772 learned_addr learned my addr 172.21.15.73:0/3341378772 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe120f81640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe11c100a80 0x7fe11c197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe11bfff640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe11c101420 0x7fe11c1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe121782640 1 -- 172.21.15.73:0/3341378772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe11c101420 msgr2=0x7fe11c1978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe121782640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe11c101420 0x7fe11c1978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe121782640 1 -- 172.21.15.73:0/3341378772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe11c100a80 msgr2=0x7fe11c197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe121782640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe11c100a80 0x7fe11c197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe121782640 1 -- 172.21.15.73:0/3341378772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c19c330 con 0x7fe11c106a80 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe11bfff640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe11c101420 0x7fe11c1978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe120f81640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe11c100a80 0x7fe11c197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe121782640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c106a80 0x7fe11c19bc50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe114007cb0 tx=0x7fe11400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe119ffb640 1 -- 172.21.15.73:0/3341378772 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11400eb30 con 0x7fe11c106a80 2024-09-10T07:47:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe119ffb640 1 -- 172.21.15.73:0/3341378772 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe11400ecd0 con 0x7fe11c106a80 2024-09-10T07:47:30.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11c19c620 con 0x7fe11c106a80 2024-09-10T07:47:30.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe119ffb640 1 -- 172.21.15.73:0/3341378772 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114015650 con 0x7fe11c106a80 2024-09-10T07:47:30.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.258+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11c06a790 con 0x7fe11c106a80 2024-09-10T07:47:30.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.259+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe11c1021c0 con 0x7fe11c106a80 2024-09-10T07:47:30.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.260+0000 7fe119ffb640 1 -- 172.21.15.73:0/3341378772 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe11400a440 con 0x7fe11c106a80 2024-09-10T07:47:30.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.261+0000 7fe119ffb640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe1040a2b80 0x7fe1040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:30.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.261+0000 7fe120f81640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe1040a2b80 0x7fe1040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:30.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.261+0000 7fe119ffb640 1 -- 172.21.15.73:0/3341378772 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7fe1140d09e0 con 0x7fe11c106a80 2024-09-10T07:47:30.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.261+0000 7fe120f81640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe1040a2b80 0x7fe1040a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009ab0 tx=0x7fe10c0094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.265+0000 7fe119ffb640 1 -- 172.21.15.73:0/3341378772 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe11409dc70 con 0x7fe11c106a80 2024-09-10T07:47:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.429+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe11c06b1b0 con 0x7fe11c106a80 2024-09-10T07:47:30.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.847+0000 7fe119ffb640 1 -- 172.21.15.73:0/3341378772 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7fe1140bd020 con 0x7fe11c106a80 2024-09-10T07:47:30.847 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-10T07:47:30.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe1040a2b80 msgr2=0x7fe1040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe1040a2b80 0x7fe1040a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009ab0 tx=0x7fe10c0094b0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c106a80 msgr2=0x7fe11c19bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c106a80 0x7fe11c19bc50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe114007cb0 tx=0x7fe11400e420 comp rx=0 tx=0).stop 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 shutdown_connections 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe1040a2b80 0x7fe1040a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe11c106a80 0x7fe11c19bc50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe11c101420 0x7fe11c1978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 --2- 172.21.15.73:0/3341378772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe11c100a80 0x7fe11c197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 >> 172.21.15.73:0/3341378772 conn(0x7fe11c0fc7a0 msgr2=0x7fe11c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 shutdown_connections 2024-09-10T07:47:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:30.849+0000 7fe1231e5640 1 -- 172.21.15.73:0/3341378772 wait complete. 2024-09-10T07:47:31.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:31 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3341378772' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T07:47:31.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:31 smithi102 ceph-mon[35514]: pgmap v271: 33 pgs: 17 creating+peering, 15 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:31.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:31 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3341378772' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T07:47:31.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:31 smithi102 ceph-mon[35514]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T07:47:31.400 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:31 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3341378772' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T07:47:31.400 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:31 smithi073 ceph-mon[30850]: pgmap v271: 33 pgs: 17 creating+peering, 15 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:31.401 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:31 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3341378772' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T07:47:31.401 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:31 smithi073 ceph-mon[30850]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T07:47:31.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:31 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3341378772' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T07:47:31.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:31 smithi159 ceph-mon[35522]: pgmap v271: 33 pgs: 17 creating+peering, 15 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:31.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:31 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3341378772' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T07:47:31.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:31 smithi159 ceph-mon[35522]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T07:47:31.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:47:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:32.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 -- 172.21.15.73:0/2927374835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228102ef0 msgr2=0x7fe22810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:32.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 --2- 172.21.15.73:0/2927374835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228102ef0 0x7fe22810da40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe220009ca0 tx=0x7fe22002a950 comp rx=0 tx=0).stop 2024-09-10T07:47:32.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 -- 172.21.15.73:0/2927374835 shutdown_connections 2024-09-10T07:47:32.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 --2- 172.21.15.73:0/2927374835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228102ef0 0x7fe22810da40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:32.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 --2- 172.21.15.73:0/2927374835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe228102570 0x7fe2281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:32.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 --2- 172.21.15.73:0/2927374835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe228100e20 0x7fe228101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:32.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 -- 172.21.15.73:0/2927374835 >> 172.21.15.73:0/2927374835 conn(0x7fe2280fc7d0 msgr2=0x7fe2280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:32.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 -- 172.21.15.73:0/2927374835 shutdown_connections 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 -- 172.21.15.73:0/2927374835 wait complete. 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 Processor -- start 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.187+0000 7fe22c83b640 1 -- start start 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22c83b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228100e20 0x7fe228198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22c83b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe228102570 0x7fe228198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22c83b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe228102ef0 0x7fe22819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22c83b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe228110fa0 con 0x7fe228100e20 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22c83b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe228110e20 con 0x7fe228102ef0 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22c83b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe228111120 con 0x7fe228102570 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228100e20 0x7fe228198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228100e20 0x7fe228198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60800/0 (socket says 172.21.15.73:60800) 2024-09-10T07:47:32.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22659c640 1 -- 172.21.15.73:0/1108641177 learned_addr learned my addr 172.21.15.73:0/1108641177 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe21ffff640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe228102570 0x7fe228198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe226d9d640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe228102ef0 0x7fe22819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22659c640 1 -- 172.21.15.73:0/1108641177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe228102570 msgr2=0x7fe228198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22659c640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe228102570 0x7fe228198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22659c640 1 -- 172.21.15.73:0/1108641177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe228102ef0 msgr2=0x7fe22819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22659c640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe228102ef0 0x7fe22819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22659c640 1 -- 172.21.15.73:0/1108641177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22819d530 con 0x7fe228100e20 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe226d9d640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe228102ef0 0x7fe22819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22659c640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228100e20 0x7fe228198580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe21800d950 tx=0x7fe21800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe21f7fe640 1 -- 172.21.15.73:0/1108641177 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218017070 con 0x7fe228100e20 2024-09-10T07:47:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22819d820 con 0x7fe228100e20 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe21f7fe640 1 -- 172.21.15.73:0/1108641177 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe21800de80 con 0x7fe228100e20 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe21f7fe640 1 -- 172.21.15.73:0/1108641177 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21800f620 con 0x7fe228100e20 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.188+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2281a5100 con 0x7fe228100e20 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.189+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe228101200 con 0x7fe228100e20 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.191+0000 7fe21f7fe640 1 -- 172.21.15.73:0/1108641177 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe218009c30 con 0x7fe228100e20 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.191+0000 7fe21f7fe640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe2140a2b80 0x7fe2140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.191+0000 7fe21ffff640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe2140a2b80 0x7fe2140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.191+0000 7fe21f7fe640 1 -- 172.21.15.73:0/1108641177 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7fe2180ceb10 con 0x7fe228100e20 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.192+0000 7fe21ffff640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe2140a2b80 0x7fe2140a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2280fef90 tx=0x7fe210009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:32.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.195+0000 7fe21f7fe640 1 -- 172.21.15.73:0/1108641177 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe21809bc20 con 0x7fe228100e20 2024-09-10T07:47:32.380 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:32 smithi102 ceph-mon[35514]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T07:47:32.380 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:32 smithi102 ceph-mon[35514]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T07:47:32.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:32 smithi159 ceph-mon[35522]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T07:47:32.410 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:32 smithi159 ceph-mon[35522]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T07:47:32.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:32.393+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe22810a0a0 con 0x7fe228100e20 2024-09-10T07:47:32.607 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:32 smithi073 ceph-mon[30850]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T07:47:32.607 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:32 smithi073 ceph-mon[30850]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T07:47:33.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.117+0000 7fe21f7fe640 1 -- 172.21.15.73:0/1108641177 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fe21809b520 con 0x7fe228100e20 2024-09-10T07:47:33.117 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T07:47:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.119+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe2140a2b80 msgr2=0x7fe2140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.119+0000 7fe22c83b640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe2140a2b80 0x7fe2140a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2280fef90 tx=0x7fe210009110 comp rx=0 tx=0).stop 2024-09-10T07:47:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.119+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228100e20 msgr2=0x7fe228198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.119+0000 7fe22c83b640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228100e20 0x7fe228198580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe21800d950 tx=0x7fe21800dd50 comp rx=0 tx=0).stop 2024-09-10T07:47:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.120+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 shutdown_connections 2024-09-10T07:47:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.120+0000 7fe22c83b640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe2140a2b80 0x7fe2140a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:33.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.120+0000 7fe22c83b640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe228102ef0 0x7fe22819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:33.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.120+0000 7fe22c83b640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe228102570 0x7fe228198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:33.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.120+0000 7fe22c83b640 1 --2- 172.21.15.73:0/1108641177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe228100e20 0x7fe228198580 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:33.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.120+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 >> 172.21.15.73:0/1108641177 conn(0x7fe2280fc7d0 msgr2=0x7fe22806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:33.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.120+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 shutdown_connections 2024-09-10T07:47:33.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:33.120+0000 7fe22c83b640 1 -- 172.21.15.73:0/1108641177 wait complete. 2024-09-10T07:47:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:33 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1108641177' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T07:47:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:33 smithi102 ceph-mon[35514]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T07:47:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:33 smithi102 ceph-mon[35514]: pgmap v274: 97 pgs: 17 creating+peering, 79 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:33.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:33 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1108641177' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T07:47:33.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:33 smithi159 ceph-mon[35522]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T07:47:33.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:33 smithi159 ceph-mon[35522]: pgmap v274: 97 pgs: 17 creating+peering, 79 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:33.407 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:33 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1108641177' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T07:47:33.407 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:33 smithi073 ceph-mon[30850]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T07:47:33.407 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:33 smithi073 ceph-mon[30850]: pgmap v274: 97 pgs: 17 creating+peering, 79 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:47:33.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T07:47:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:34.361 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:34 smithi073 ceph-mon[30850]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T07:47:34.361 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:34 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1108641177' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T07:47:34.361 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:34 smithi073 ceph-mon[30850]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T07:47:34.361 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:34 smithi073 ceph-mon[30850]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T07:47:34.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:34 smithi102 ceph-mon[35514]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T07:47:34.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:34 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1108641177' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T07:47:34.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:34 smithi102 ceph-mon[35514]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T07:47:34.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:34 smithi102 ceph-mon[35514]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T07:47:34.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:34 smithi159 ceph-mon[35522]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T07:47:34.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:34 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1108641177' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T07:47:34.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:34 smithi159 ceph-mon[35522]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T07:47:34.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:34 smithi159 ceph-mon[35522]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T07:47:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.441+0000 7f2612335640 1 -- 172.21.15.73:0/4023916561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c102d40 msgr2=0x7f260c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.441+0000 7f2612335640 1 --2- 172.21.15.73:0/4023916561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c102d40 0x7f260c103120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009900 tx=0x7f25fc02a480 comp rx=0 tx=0).stop 2024-09-10T07:47:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.441+0000 7f2612335640 1 -- 172.21.15.73:0/4023916561 shutdown_connections 2024-09-10T07:47:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.441+0000 7f2612335640 1 --2- 172.21.15.73:0/4023916561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f260c10c170 0x7f260c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.441+0000 7f2612335640 1 --2- 172.21.15.73:0/4023916561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f260c103660 0x7f260c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.441+0000 7f2612335640 1 --2- 172.21.15.73:0/4023916561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c102d40 0x7f260c103120 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.441+0000 7f2612335640 1 -- 172.21.15.73:0/4023916561 >> 172.21.15.73:0/4023916561 conn(0x7f260c0fc7a0 msgr2=0x7f260c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.441+0000 7f2612335640 1 -- 172.21.15.73:0/4023916561 shutdown_connections 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.441+0000 7f2612335640 1 -- 172.21.15.73:0/4023916561 wait complete. 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f2612335640 1 Processor -- start 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f2612335640 1 -- start start 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f2612335640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f260c102d40 0x7f260c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f2612335640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c103660 0x7f260c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f2612335640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f260c10c170 0x7f260c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f2612335640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f260c111fb0 con 0x7f260c103660 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f2612335640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f260c111e30 con 0x7f260c102d40 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f2612335640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f260c112130 con 0x7f260c10c170 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c103660 0x7f260c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c103660 0x7f260c19abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60806/0 (socket says 172.21.15.73:60806) 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260b7fe640 1 -- 172.21.15.73:0/3302644710 learned_addr learned my addr 172.21.15.73:0/3302644710 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260bfff640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f260c102d40 0x7f260c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260b7fe640 1 -- 172.21.15.73:0/3302644710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f260c10c170 msgr2=0x7f260c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260b7fe640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f260c10c170 0x7f260c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260b7fe640 1 -- 172.21.15.73:0/3302644710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f260c102d40 msgr2=0x7f260c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260b7fe640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f260c102d40 0x7f260c19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260b7fe640 1 -- 172.21.15.73:0/3302644710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260c19f630 con 0x7f260c103660 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.442+0000 7f260b7fe640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c103660 0x7f260c19abc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f260000c940 tx=0x7f260000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.443+0000 7f26097fa640 1 -- 172.21.15.73:0/3302644710 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600004220 con 0x7f260c103660 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.443+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260c19f920 con 0x7f260c103660 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.443+0000 7f26097fa640 1 -- 172.21.15.73:0/3302644710 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26000043c0 con 0x7f260c103660 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.443+0000 7f26097fa640 1 -- 172.21.15.73:0/3302644710 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600004a00 con 0x7f260c103660 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.443+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260c1a7200 con 0x7f260c103660 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.444+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260c103120 con 0x7f260c103660 2024-09-10T07:47:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.445+0000 7f26097fa640 1 -- 172.21.15.73:0/3302644710 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f26000079b0 con 0x7f260c103660 2024-09-10T07:47:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.445+0000 7f26097fa640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25f40a2b80 0x7f25f40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.446+0000 7f26097fa640 1 -- 172.21.15.73:0/3302644710 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f26000cef60 con 0x7f260c103660 2024-09-10T07:47:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.446+0000 7f260bfff640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25f40a2b80 0x7f25f40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.446+0000 7f260bfff640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25f40a2b80 0x7f25f40a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0096c0 tx=0x7f25fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.449+0000 7f26097fa640 1 -- 172.21.15.73:0/3302644710 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2600014030 con 0x7f260c103660 2024-09-10T07:47:34.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.617+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f260c19b9e0 con 0x7f260c103660 2024-09-10T07:47:34.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.618+0000 7f26097fa640 1 -- 172.21.15.73:0/3302644710 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22276 (secure 0 0 0) 0x7f260c19b9e0 con 0x7f260c103660 2024-09-10T07:47:34.618 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:34.618 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":81,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:47:32.394793+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:47:28.792230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:47:30.666653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:47:34.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25f40a2b80 msgr2=0x7f25f40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:34.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25f40a2b80 0x7f25f40a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0096c0 tx=0x7f25fc000bc0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c103660 msgr2=0x7f260c19abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c103660 0x7f260c19abc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f260000c940 tx=0x7f260000ce00 comp rx=0 tx=0).stop 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 shutdown_connections 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f25f40a2b80 0x7f25f40a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f260c10c170 0x7f260c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f260c103660 0x7f260c19abc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 --2- 172.21.15.73:0/3302644710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f260c102d40 0x7f260c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 >> 172.21.15.73:0/3302644710 conn(0x7f260c0fc7a0 msgr2=0x7f260c10d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 shutdown_connections 2024-09-10T07:47:34.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:34.621+0000 7f2612335640 1 -- 172.21.15.73:0/3302644710 wait complete. 2024-09-10T07:47:35.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:35 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] up:active 2024-09-10T07:47:35.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:35 smithi073 ceph-mon[30850]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T07:47:35.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:35 smithi073 ceph-mon[30850]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T07:47:35.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:35 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3302644710' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:47:35.308 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:35 smithi073 ceph-mon[30850]: pgmap v276: 97 pgs: 11 creating+peering, 21 unknown, 65 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T07:47:35.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T07:47:35.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:35 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] up:active 2024-09-10T07:47:35.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:35 smithi102 ceph-mon[35514]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T07:47:35.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:35 smithi102 ceph-mon[35514]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T07:47:35.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:35 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3302644710' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:47:35.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:35 smithi102 ceph-mon[35514]: pgmap v276: 97 pgs: 11 creating+peering, 21 unknown, 65 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T07:47:35.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:35 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] up:active 2024-09-10T07:47:35.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:35 smithi159 ceph-mon[35522]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T07:47:35.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:35 smithi159 ceph-mon[35522]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T07:47:35.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:35 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3302644710' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:47:35.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:35 smithi159 ceph-mon[35522]: pgmap v276: 97 pgs: 11 creating+peering, 21 unknown, 65 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T07:47:35.578 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:36.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.031+0000 7fd87f9cc640 1 -- 172.21.15.73:0/107955128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878106a60 msgr2=0x7fd878106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:36.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.031+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/107955128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878106a60 0x7fd878106e40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd874009930 tx=0x7fd87402a440 comp rx=0 tx=0).stop 2024-09-10T07:47:36.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.031+0000 7fd87f9cc640 1 -- 172.21.15.73:0/107955128 shutdown_connections 2024-09-10T07:47:36.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.031+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/107955128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd878101400 0x7fd87810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:36.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.031+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/107955128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd878100a60 0x7fd878100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.031+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/107955128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878106a60 0x7fd878106e40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.031+0000 7fd87f9cc640 1 -- 172.21.15.73:0/107955128 >> 172.21.15.73:0/107955128 conn(0x7fd8780fc780 msgr2=0x7fd8780feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.031+0000 7fd87f9cc640 1 -- 172.21.15.73:0/107955128 shutdown_connections 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.031+0000 7fd87f9cc640 1 -- 172.21.15.73:0/107955128 wait complete. 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87f9cc640 1 Processor -- start 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87f9cc640 1 -- start start 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87f9cc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878100a60 0x7fd878197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87f9cc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd878101400 0x7fd878197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87f9cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd878106a60 0x7fd87819bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87f9cc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd878110e60 con 0x7fd878100a60 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87f9cc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd878110ce0 con 0x7fd878106a60 2024-09-10T07:47:36.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87f9cc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd878110fe0 con 0x7fd878101400 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87d768640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878100a60 0x7fd878197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87d768640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878100a60 0x7fd878197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60832/0 (socket says 172.21.15.73:60832) 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87d768640 1 -- 172.21.15.73:0/3691509010 learned_addr learned my addr 172.21.15.73:0/3691509010 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87cf67640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd878101400 0x7fd878197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87d768640 1 -- 172.21.15.73:0/3691509010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd878101400 msgr2=0x7fd878197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87d768640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd878101400 0x7fd878197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87d768640 1 -- 172.21.15.73:0/3691509010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd878106a60 msgr2=0x7fd87819bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87d768640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd878106a60 0x7fd87819bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87d768640 1 -- 172.21.15.73:0/3691509010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87819c2b0 con 0x7fd878100a60 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd87d768640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878100a60 0x7fd878197300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd874009230 tx=0x7fd874004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.032+0000 7fd86e7fc640 1 -- 172.21.15.73:0/3691509010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87403f030 con 0x7fd878100a60 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.033+0000 7fd86e7fc640 1 -- 172.21.15.73:0/3691509010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd874003ad0 con 0x7fd878100a60 2024-09-10T07:47:36.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.033+0000 7fd86e7fc640 1 -- 172.21.15.73:0/3691509010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874035070 con 0x7fd878100a60 2024-09-10T07:47:36.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.033+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87819c540 con 0x7fd878100a60 2024-09-10T07:47:36.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.033+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8781a3e80 con 0x7fd878100a60 2024-09-10T07:47:36.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.033+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd878100ec0 con 0x7fd878100a60 2024-09-10T07:47:36.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.035+0000 7fd86e7fc640 1 -- 172.21.15.73:0/3691509010 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd874042030 con 0x7fd878100a60 2024-09-10T07:47:36.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.035+0000 7fd86e7fc640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd8640a2c00 0x7fd8640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:36.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.035+0000 7fd87cf67640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd8640a2c00 0x7fd8640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:36.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.035+0000 7fd86e7fc640 1 -- 172.21.15.73:0/3691509010 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fd8740ef3f0 con 0x7fd878100a60 2024-09-10T07:47:36.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.036+0000 7fd87cf67640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd8640a2c00 0x7fd8640a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd8781060f0 tx=0x7fd86800b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:36.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.039+0000 7fd86e7fc640 1 -- 172.21.15.73:0/3691509010 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd8740bc4a0 con 0x7fd878100a60 2024-09-10T07:47:36.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.208+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd878108a40 con 0x7fd878100a60 2024-09-10T07:47:36.208 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:36 smithi073 ceph-mon[30850]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T07:47:36.208 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:36 smithi073 ceph-mon[30850]: Cluster is now healthy 2024-09-10T07:47:36.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.211+0000 7fd86e7fc640 1 -- 172.21.15.73:0/3691509010 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22276 (secure 0 0 0) 0x7fd8740bbda0 con 0x7fd878100a60 2024-09-10T07:47:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:36.211 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":81,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:47:32.394793+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:47:28.792230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:47:30.666653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:47:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd8640a2c00 msgr2=0x7fd8640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd8640a2c00 0x7fd8640a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd8781060f0 tx=0x7fd86800b590 comp rx=0 tx=0).stop 2024-09-10T07:47:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878100a60 msgr2=0x7fd878197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878100a60 0x7fd878197300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd874009230 tx=0x7fd874004270 comp rx=0 tx=0).stop 2024-09-10T07:47:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 shutdown_connections 2024-09-10T07:47:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd8640a2c00 0x7fd8640a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd878106a60 0x7fd87819bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd878101400 0x7fd878197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 --2- 172.21.15.73:0/3691509010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd878100a60 0x7fd878197300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 >> 172.21.15.73:0/3691509010 conn(0x7fd8780fc780 msgr2=0x7fd8780fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 shutdown_connections 2024-09-10T07:47:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:36.213+0000 7fd87f9cc640 1 -- 172.21.15.73:0/3691509010 wait complete. 2024-09-10T07:47:36.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:36 smithi102 ceph-mon[35514]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T07:47:36.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:36 smithi102 ceph-mon[35514]: Cluster is now healthy 2024-09-10T07:47:36.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:36 smithi159 ceph-mon[35522]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T07:47:36.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:36 smithi159 ceph-mon[35522]: Cluster is now healthy 2024-09-10T07:47:36.918 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:47:37.162 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:37 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3691509010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:47:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:37 smithi159 ceph-mon[35522]: pgmap v277: 97 pgs: 97 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-10T07:47:37.423 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:37 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3691509010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:47:37.423 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:37 smithi073 ceph-mon[30850]: pgmap v277: 97 pgs: 97 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-10T07:47:37.604 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:37 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3691509010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:47:37.604 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:37 smithi102 ceph-mon[35514]: pgmap v277: 97 pgs: 97 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-10T07:47:37.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.633+0000 7fef39370640 1 -- 172.21.15.73:0/34234475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102570 msgr2=0x7fef341029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:37.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.633+0000 7fef39370640 1 --2- 172.21.15.73:0/34234475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102570 0x7fef341029b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef28009900 tx=0x7fef2802a480 comp rx=0 tx=0).stop 2024-09-10T07:47:37.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.633+0000 7fef39370640 1 -- 172.21.15.73:0/34234475 shutdown_connections 2024-09-10T07:47:37.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.633+0000 7fef39370640 1 --2- 172.21.15.73:0/34234475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef34102ef0 0x7fef3410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:37.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.633+0000 7fef39370640 1 --2- 172.21.15.73:0/34234475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102570 0x7fef341029b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:37.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.633+0000 7fef39370640 1 --2- 172.21.15.73:0/34234475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef34100e20 0x7fef34101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:37.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.633+0000 7fef39370640 1 -- 172.21.15.73:0/34234475 >> 172.21.15.73:0/34234475 conn(0x7fef340fc7d0 msgr2=0x7fef340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:37.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 -- 172.21.15.73:0/34234475 shutdown_connections 2024-09-10T07:47:37.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 -- 172.21.15.73:0/34234475 wait complete. 2024-09-10T07:47:37.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 Processor -- start 2024-09-10T07:47:37.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 -- start start 2024-09-10T07:47:37.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef34100e20 0x7fef34199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:37.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef34102570 0x7fef34199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:37.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102ef0 0x7fef341a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:37.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fef34110fa0 con 0x7fef34102ef0 2024-09-10T07:47:37.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fef34110e20 con 0x7fef34102570 2024-09-10T07:47:37.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.634+0000 7fef39370640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fef34111120 con 0x7fef34100e20 2024-09-10T07:47:37.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef337fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102ef0 0x7fef341a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef337fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102ef0 0x7fef341a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60858/0 (socket says 172.21.15.73:60858) 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef337fe640 1 -- 172.21.15.73:0/2882289 learned_addr learned my addr 172.21.15.73:0/2882289 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef327fc640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef34102570 0x7fef34199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef32ffd640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef34100e20 0x7fef34199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef337fe640 1 -- 172.21.15.73:0/2882289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef34100e20 msgr2=0x7fef34199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef337fe640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef34100e20 0x7fef34199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef337fe640 1 -- 172.21.15.73:0/2882289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef34102570 msgr2=0x7fef34199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef337fe640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef34102570 0x7fef34199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef337fe640 1 -- 172.21.15.73:0/2882289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef341a49f0 con 0x7fef34102ef0 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef327fc640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef34102570 0x7fef34199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef337fe640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102ef0 0x7fef341a44b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00eaa0 tx=0x7fef2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef1bfff640 1 -- 172.21.15.73:0/2882289 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00cdb0 con 0x7fef34102ef0 2024-09-10T07:47:37.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef1bfff640 1 -- 172.21.15.73:0/2882289 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef2c005020 con 0x7fef34102ef0 2024-09-10T07:47:37.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef341a4bc0 con 0x7fef34102ef0 2024-09-10T07:47:37.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef1bfff640 1 -- 172.21.15.73:0/2882289 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0116b0 con 0x7fef34102ef0 2024-09-10T07:47:37.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.635+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef341a50d0 con 0x7fef34102ef0 2024-09-10T07:47:37.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.636+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef34101200 con 0x7fef34102ef0 2024-09-10T07:47:37.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.637+0000 7fef1bfff640 1 -- 172.21.15.73:0/2882289 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fef2c005560 con 0x7fef34102ef0 2024-09-10T07:47:37.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.638+0000 7fef1bfff640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fef1c0a2c00 0x7fef1c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:37.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.638+0000 7fef32ffd640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fef1c0a2c00 0x7fef1c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:37.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.638+0000 7fef1bfff640 1 -- 172.21.15.73:0/2882289 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fef2c0cf190 con 0x7fef34102ef0 2024-09-10T07:47:37.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.639+0000 7fef32ffd640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fef1c0a2c00 0x7fef1c0a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef24009890 tx=0x7fef24008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:37.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.642+0000 7fef1bfff640 1 -- 172.21.15.73:0/2882289 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef2c016030 con 0x7fef34102ef0 2024-09-10T07:47:37.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:37.846+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fef34109090 con 0x7fef34102ef0 2024-09-10T07:47:37.876 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:47:37 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b[65355]: 2024-09-10T07:47:37.603+0000 7ff24b076640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:47:38.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.133+0000 7fef1bfff640 1 -- 172.21.15.73:0/2882289 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fef2c09c240 con 0x7fef34102ef0 2024-09-10T07:47:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fef1c0a2c00 msgr2=0x7fef1c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fef1c0a2c00 0x7fef1c0a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef24009890 tx=0x7fef24008040 comp rx=0 tx=0).stop 2024-09-10T07:47:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102ef0 msgr2=0x7fef341a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102ef0 0x7fef341a44b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00eaa0 tx=0x7fef2c00ef60 comp rx=0 tx=0).stop 2024-09-10T07:47:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 shutdown_connections 2024-09-10T07:47:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fef1c0a2c00 0x7fef1c0a50c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef34102ef0 0x7fef341a44b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef34102570 0x7fef34199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 --2- 172.21.15.73:0/2882289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef34100e20 0x7fef34199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.135+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 >> 172.21.15.73:0/2882289 conn(0x7fef340fc7d0 msgr2=0x7fef340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.136+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 shutdown_connections 2024-09-10T07:47:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:38.136+0000 7fef39370640 1 -- 172.21.15.73:0/2882289 wait complete. 2024-09-10T07:47:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:38 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2882289' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T07:47:38.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:38 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2882289' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T07:47:38.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:38 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2882289' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T07:47:38.767 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-10T07:47:38.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T07:47:39.012 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:39.401 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:39 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2882289' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T07:47:39.401 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:39 smithi073 ceph-mon[30850]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T07:47:39.401 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:39 smithi073 ceph-mon[30850]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-10T07:47:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:39 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2882289' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T07:47:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:39 smithi159 ceph-mon[35522]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T07:47:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:39 smithi159 ceph-mon[35522]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-10T07:47:39.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.483+0000 7fe34a7af640 1 -- 172.21.15.73:0/1650772431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 msgr2=0x7fe34410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.483+0000 7fe34a7af640 1 --2- 172.21.15.73:0/1650772431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 0x7fe34410ea90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009ca0 tx=0x7fe33c02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.483+0000 7fe34a7af640 1 -- 172.21.15.73:0/1650772431 shutdown_connections 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.483+0000 7fe34a7af640 1 --2- 172.21.15.73:0/1650772431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 0x7fe34410ea90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.483+0000 7fe34a7af640 1 --2- 172.21.15.73:0/1650772431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe344102790 0x7fe3441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.483+0000 7fe34a7af640 1 --2- 172.21.15.73:0/1650772431 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe344101de0 0x7fe3441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.483+0000 7fe34a7af640 1 -- 172.21.15.73:0/1650772431 >> 172.21.15.73:0/1650772431 conn(0x7fe3440fd8c0 msgr2=0x7fe3440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.483+0000 7fe34a7af640 1 -- 172.21.15.73:0/1650772431 shutdown_connections 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.483+0000 7fe34a7af640 1 -- 172.21.15.73:0/1650772431 wait complete. 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe34a7af640 1 Processor -- start 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe34a7af640 1 -- start start 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe34a7af640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe344101de0 0x7fe3441983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe34a7af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe344102790 0x7fe344198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe34a7af640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 0x7fe34419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe34a7af640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe344111f70 con 0x7fe344106f10 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe34a7af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe344111df0 con 0x7fe344102790 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe34a7af640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe3441120f0 con 0x7fe344101de0 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe348d4c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 0x7fe34419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe348d4c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 0x7fe34419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60878/0 (socket says 172.21.15.73:60878) 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.484+0000 7fe348d4c640 1 -- 172.21.15.73:0/38566127 learned_addr learned my addr 172.21.15.73:0/38566127 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe343fff640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe344101de0 0x7fe3441983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe3437fe640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe344102790 0x7fe344198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe348d4c640 1 -- 172.21.15.73:0/38566127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe344101de0 msgr2=0x7fe3441983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe348d4c640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe344101de0 0x7fe3441983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe348d4c640 1 -- 172.21.15.73:0/38566127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe344102790 msgr2=0x7fe344198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe348d4c640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe344102790 0x7fe344198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe348d4c640 1 -- 172.21.15.73:0/38566127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34419d3a0 con 0x7fe344106f10 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe348d4c640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 0x7fe34419ccc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe33c031a20 tx=0x7fe33c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe3417fa640 1 -- 172.21.15.73:0/38566127 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c003c30 con 0x7fe344106f10 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe3417fa640 1 -- 172.21.15.73:0/38566127 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe33c003dd0 con 0x7fe344106f10 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34419d630 con 0x7fe344106f10 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe3417fa640 1 -- 172.21.15.73:0/38566127 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c02fcf0 con 0x7fe344106f10 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.485+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3441a4f70 con 0x7fe344106f10 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.486+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3441021c0 con 0x7fe344106f10 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.487+0000 7fe3417fa640 1 -- 172.21.15.73:0/38566127 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe33c004050 con 0x7fe344106f10 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.488+0000 7fe3417fa640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe32c0a2b80 0x7fe32c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.488+0000 7fe343fff640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe32c0a2b80 0x7fe32c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.488+0000 7fe3417fa640 1 -- 172.21.15.73:0/38566127 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fe33c0f0240 con 0x7fe344106f10 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.488+0000 7fe343fff640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe32c0a2b80 0x7fe32c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe33400bbe0 tx=0x7fe33400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.492+0000 7fe3417fa640 1 -- 172.21.15.73:0/38566127 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe33c0bd380 con 0x7fe344106f10 2024-09-10T07:47:39.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:39 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2882289' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T07:47:39.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:39 smithi102 ceph-mon[35514]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T07:47:39.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:39 smithi102 ceph-mon[35514]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-10T07:47:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:39.695+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fe34410a150 con 0x7fe344106f10 2024-09-10T07:47:40.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.094+0000 7fe3417fa640 1 -- 172.21.15.73:0/38566127 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7fe33c02fe90 con 0x7fe344106f10 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe32c0a2b80 msgr2=0x7fe32c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe32c0a2b80 0x7fe32c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe33400bbe0 tx=0x7fe33400b390 comp rx=0 tx=0).stop 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 msgr2=0x7fe34419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 0x7fe34419ccc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe33c031a20 tx=0x7fe33c031a50 comp rx=0 tx=0).stop 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 shutdown_connections 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe32c0a2b80 0x7fe32c0a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe344106f10 0x7fe34419ccc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe344102790 0x7fe344198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 --2- 172.21.15.73:0/38566127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe344101de0 0x7fe3441983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 >> 172.21.15.73:0/38566127 conn(0x7fe3440fd8c0 msgr2=0x7fe3440feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:40.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 shutdown_connections 2024-09-10T07:47:40.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:40.096+0000 7fe34a7af640 1 -- 172.21.15.73:0/38566127 wait complete. 2024-09-10T07:47:40.386 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:40 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/38566127' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T07:47:40.386 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:40 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/38566127' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T07:47:40.386 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:40 smithi073 ceph-mon[30850]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-10T07:47:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:40 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/38566127' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T07:47:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:40 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/38566127' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T07:47:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:40 smithi159 ceph-mon[35522]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-10T07:47:40.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:40 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/38566127' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T07:47:40.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:40 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/38566127' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T07:47:40.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:40 smithi102 ceph-mon[35514]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-10T07:47:40.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T07:47:41.153 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:41.401 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:41 smithi073 ceph-mon[30850]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-10T07:47:41.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:41 smithi159 ceph-mon[35522]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-10T07:47:41.625 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:41 smithi102 ceph-mon[35514]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.634+0000 7f53a21a8640 1 -- 172.21.15.73:0/2108853142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c1082a0 msgr2=0x7f539c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.634+0000 7f53a21a8640 1 --2- 172.21.15.73:0/2108853142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c1082a0 0x7f539c10ec40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5394009cd0 tx=0x7f539402a910 comp rx=0 tx=0).stop 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.635+0000 7f53a21a8640 1 -- 172.21.15.73:0/2108853142 shutdown_connections 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.635+0000 7f53a21a8640 1 --2- 172.21.15.73:0/2108853142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c1082a0 0x7f539c10ec40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.635+0000 7f53a21a8640 1 --2- 172.21.15.73:0/2108853142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f539c1036e0 0x7f539c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.635+0000 7f53a21a8640 1 --2- 172.21.15.73:0/2108853142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f539c102d30 0x7f539c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.635+0000 7f53a21a8640 1 -- 172.21.15.73:0/2108853142 >> 172.21.15.73:0/2108853142 conn(0x7f539c0fc7d0 msgr2=0x7f539c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.635+0000 7f53a21a8640 1 -- 172.21.15.73:0/2108853142 shutdown_connections 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.635+0000 7f53a21a8640 1 -- 172.21.15.73:0/2108853142 wait complete. 2024-09-10T07:47:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.635+0000 7f53a21a8640 1 Processor -- start 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.635+0000 7f53a21a8640 1 -- start start 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53a21a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c102d30 0x7f539c198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53a21a8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f539c1036e0 0x7f539c198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53a21a8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f539c1082a0 0x7f539c19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53a21a8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f539c112160 con 0x7f539c102d30 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53a21a8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f539c111fe0 con 0x7f539c1082a0 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53a21a8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1122e0 con 0x7f539c1036e0 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c102d30 0x7f539c198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c102d30 0x7f539c198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57370/0 (socket says 172.21.15.73:57370) 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539b7fe640 1 -- 172.21.15.73:0/804682708 learned_addr learned my addr 172.21.15.73:0/804682708 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539bfff640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f539c1082a0 0x7f539c19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f5392ffd640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f539c1036e0 0x7f539c198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539b7fe640 1 -- 172.21.15.73:0/804682708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f539c1036e0 msgr2=0x7f539c198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539b7fe640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f539c1036e0 0x7f539c198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539b7fe640 1 -- 172.21.15.73:0/804682708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f539c1082a0 msgr2=0x7f539c19d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539b7fe640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f539c1082a0 0x7f539c19d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539b7fe640 1 -- 172.21.15.73:0/804682708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539c19d6f0 con 0x7f539c102d30 2024-09-10T07:47:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f539b7fe640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c102d30 0x7f539c198740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f538c00b4a0 tx=0x7f538c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53997fa640 1 -- 172.21.15.73:0/804682708 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c015020 con 0x7f539c102d30 2024-09-10T07:47:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539c19d9e0 con 0x7f539c102d30 2024-09-10T07:47:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53997fa640 1 -- 172.21.15.73:0/804682708 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f538c011d10 con 0x7f539c102d30 2024-09-10T07:47:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53997fa640 1 -- 172.21.15.73:0/804682708 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c00f2e0 con 0x7f539c102d30 2024-09-10T07:47:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.636+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539c1a52c0 con 0x7f539c102d30 2024-09-10T07:47:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.637+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f539c06a850 con 0x7f539c102d30 2024-09-10T07:47:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.638+0000 7f53997fa640 1 -- 172.21.15.73:0/804682708 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f538c018020 con 0x7f539c102d30 2024-09-10T07:47:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.639+0000 7f53997fa640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f53880a2b80 0x7f53880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.639+0000 7f5392ffd640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f53880a2b80 0x7f53880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.639+0000 7f53997fa640 1 -- 172.21.15.73:0/804682708 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f538c0ce740 con 0x7f539c102d30 2024-09-10T07:47:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.640+0000 7f5392ffd640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f53880a2b80 0x7f53880a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f539c0fedc0 tx=0x7f5384009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.643+0000 7f53997fa640 1 -- 172.21.15.73:0/804682708 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f538c01f020 con 0x7f539c102d30 2024-09-10T07:47:41.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:41.845+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f539c10a2b0 con 0x7f539c102d30 2024-09-10T07:47:42.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.152+0000 7f53997fa640 1 -- 172.21.15.73:0/804682708 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7f538c09b7f0 con 0x7f539c102d30 2024-09-10T07:47:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.155+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f53880a2b80 msgr2=0x7f53880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.155+0000 7f53a21a8640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f53880a2b80 0x7f53880a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f539c0fedc0 tx=0x7f5384009110 comp rx=0 tx=0).stop 2024-09-10T07:47:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.155+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c102d30 msgr2=0x7f539c198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.155+0000 7f53a21a8640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c102d30 0x7f539c198740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f538c00b4a0 tx=0x7f538c00b8a0 comp rx=0 tx=0).stop 2024-09-10T07:47:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.156+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 shutdown_connections 2024-09-10T07:47:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.156+0000 7f53a21a8640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f53880a2b80 0x7f53880a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.156+0000 7f53a21a8640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f539c1082a0 0x7f539c19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.156+0000 7f53a21a8640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f539c1036e0 0x7f539c198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:42.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.156+0000 7f53a21a8640 1 --2- 172.21.15.73:0/804682708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f539c102d30 0x7f539c198740 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.156+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 >> 172.21.15.73:0/804682708 conn(0x7f539c0fc7d0 msgr2=0x7f539c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.156+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 shutdown_connections 2024-09-10T07:47:42.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:42.156+0000 7f53a21a8640 1 -- 172.21.15.73:0/804682708 wait complete. 2024-09-10T07:47:42.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:42 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/804682708' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T07:47:42.471 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:42 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/804682708' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T07:47:42.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:42 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/804682708' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T07:47:42.790 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-10T07:47:42.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T07:47:43.037 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:43.449 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:43 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/804682708' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T07:47:43.450 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:43 smithi073 ceph-mon[30850]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-10T07:47:43.450 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:43 smithi073 ceph-mon[30850]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-10T07:47:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 -- 172.21.15.73:0/4086743050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 msgr2=0x7f69f8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/4086743050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 0x7f69f8101200 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009900 tx=0x7f69e802a480 comp rx=0 tx=0).stop 2024-09-10T07:47:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 -- 172.21.15.73:0/4086743050 shutdown_connections 2024-09-10T07:47:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/4086743050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f8102ef0 0x7f69f810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/4086743050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f8102570 0x7f69f81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:43.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/4086743050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 0x7f69f8101200 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 -- 172.21.15.73:0/4086743050 >> 172.21.15.73:0/4086743050 conn(0x7f69f80fc7d0 msgr2=0x7f69f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 -- 172.21.15.73:0/4086743050 shutdown_connections 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 -- 172.21.15.73:0/4086743050 wait complete. 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.450+0000 7f69fdc6c640 1 Processor -- start 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69fdc6c640 1 -- start start 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69fdc6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 0x7f69f80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69fdc6c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f8102570 0x7f69f80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69fdc6c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f8102ef0 0x7f69f80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69fdc6c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8111020 con 0x7f69f8100e20 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69fdc6c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8110ea0 con 0x7f69f8102570 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69fdc6c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f69f81111a0 con 0x7f69f8102ef0 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 0x7f69f80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 0x7f69f80fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57378/0 (socket says 172.21.15.73:57378) 2024-09-10T07:47:43.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f77fe640 1 -- 172.21.15.73:0/791725047 learned_addr learned my addr 172.21.15.73:0/791725047 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f7fff640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f8102ef0 0x7f69f80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f6ffd640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f8102570 0x7f69f80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f77fe640 1 -- 172.21.15.73:0/791725047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f8102ef0 msgr2=0x7f69f80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f77fe640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f8102ef0 0x7f69f80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f77fe640 1 -- 172.21.15.73:0/791725047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f8102570 msgr2=0x7f69f80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f77fe640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f8102570 0x7f69f80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f77fe640 1 -- 172.21.15.73:0/791725047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f81a6bd0 con 0x7f69f8100e20 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f6ffd640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f8102570 0x7f69f80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.451+0000 7f69f77fe640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 0x7f69f80fcc80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f69e8006010 tx=0x7f69e8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.452+0000 7f69f4ff9640 1 -- 172.21.15.73:0/791725047 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e803f070 con 0x7f69f8100e20 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.452+0000 7f69f4ff9640 1 -- 172.21.15.73:0/791725047 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69e8031e30 con 0x7f69f8100e20 2024-09-10T07:47:43.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.452+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f81a6e60 con 0x7f69f8100e20 2024-09-10T07:47:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.452+0000 7f69f4ff9640 1 -- 172.21.15.73:0/791725047 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8035030 con 0x7f69f8100e20 2024-09-10T07:47:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.452+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f81a72c0 con 0x7f69f8100e20 2024-09-10T07:47:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.453+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f8101280 con 0x7f69f8100e20 2024-09-10T07:47:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.454+0000 7f69f4ff9640 1 -- 172.21.15.73:0/791725047 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f69e8042070 con 0x7f69f8100e20 2024-09-10T07:47:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.454+0000 7f69f4ff9640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69e00a2c00 0x7f69e00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.455+0000 7f69f6ffd640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69e00a2c00 0x7f69e00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.455+0000 7f69f4ff9640 1 -- 172.21.15.73:0/791725047 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f69e80ef7c0 con 0x7f69f8100e20 2024-09-10T07:47:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.455+0000 7f69f6ffd640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69e00a2c00 0x7f69e00a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69f80fe710 tx=0x7f69ec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:43.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.459+0000 7f69f4ff9640 1 -- 172.21.15.73:0/791725047 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69e80bc870 con 0x7f69f8100e20 2024-09-10T07:47:43.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:43 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/804682708' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T07:47:43.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:43 smithi102 ceph-mon[35514]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-10T07:47:43.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:43 smithi102 ceph-mon[35514]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-10T07:47:43.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.648+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f69f8062630 con 0x7f69e00a2c00 2024-09-10T07:47:43.656 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:43 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/804682708' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T07:47:43.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:43 smithi159 ceph-mon[35522]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-10T07:47:43.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:43 smithi159 ceph-mon[35522]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-10T07:47:43.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.667+0000 7f69f4ff9640 1 -- 172.21.15.73:0/791725047 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f69f8062630 con 0x7f69e00a2c00 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69e00a2c00 msgr2=0x7f69e00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69e00a2c00 0x7f69e00a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69f80fe710 tx=0x7f69ec008040 comp rx=0 tx=0).stop 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 msgr2=0x7f69f80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 0x7f69f80fcc80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f69e8006010 tx=0x7f69e8003c80 comp rx=0 tx=0).stop 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 shutdown_connections 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69e00a2c00 0x7f69e00a50c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f8102ef0 0x7f69f80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f8102570 0x7f69f80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 --2- 172.21.15.73:0/791725047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f8100e20 0x7f69f80fcc80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:43.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 >> 172.21.15.73:0/791725047 conn(0x7f69f80fc7d0 msgr2=0x7f69f806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:43.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 shutdown_connections 2024-09-10T07:47:43.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:43.669+0000 7f69fdc6c640 1 -- 172.21.15.73:0/791725047 wait complete. 2024-09-10T07:47:43.722 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:47:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:47:43.653+0000 7f7dbf921640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:47:43.722 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:47:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:47:43.653+0000 7f7dbf921640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:47:43.722 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:47:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:47:43.653+0000 7f7dbf921640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:47:43.722 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:47:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:47:43.653+0000 7f7dbf921640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:47:43.722 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:47:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:47:43.653+0000 7f7dbf921640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:47:44.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:44 smithi073 ceph-mon[30850]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:44.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T07:47:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:44.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:44 smithi102 ceph-mon[35514]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:44.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:44 smithi159 ceph-mon[35522]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:45.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.008+0000 7f23dad4d640 1 -- 172.21.15.73:0/2504187375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4100a80 msgr2=0x7f23d4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:45.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.008+0000 7f23dad4d640 1 --2- 172.21.15.73:0/2504187375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4100a80 0x7f23d4100ee0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009930 tx=0x7f23c002a420 comp rx=0 tx=0).stop 2024-09-10T07:47:45.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.008+0000 7f23dad4d640 1 -- 172.21.15.73:0/2504187375 shutdown_connections 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.008+0000 7f23dad4d640 1 --2- 172.21.15.73:0/2504187375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d4101420 0x7f23d410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.008+0000 7f23dad4d640 1 --2- 172.21.15.73:0/2504187375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4100a80 0x7f23d4100ee0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.008+0000 7f23dad4d640 1 --2- 172.21.15.73:0/2504187375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d4106a80 0x7f23d4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.008+0000 7f23dad4d640 1 -- 172.21.15.73:0/2504187375 >> 172.21.15.73:0/2504187375 conn(0x7f23d40fc7a0 msgr2=0x7f23d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.008+0000 7f23dad4d640 1 -- 172.21.15.73:0/2504187375 shutdown_connections 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.008+0000 7f23dad4d640 1 -- 172.21.15.73:0/2504187375 wait complete. 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23dad4d640 1 Processor -- start 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23dad4d640 1 -- start start 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23dad4d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d4100a80 0x7f23d4199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23dad4d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d4101420 0x7f23d4199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23dad4d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4106a80 0x7f23d41a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:45.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23dad4d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4110f70 con 0x7f23d4106a80 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23dad4d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4110df0 con 0x7f23d4101420 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23dad4d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41110f0 con 0x7f23d4100a80 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23d92ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4106a80 0x7f23d41a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23d92ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4106a80 0x7f23d41a44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57402/0 (socket says 172.21.15.73:57402) 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23d92ea640 1 -- 172.21.15.73:0/1891379533 learned_addr learned my addr 172.21.15.73:0/1891379533 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23d8ae9640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d4100a80 0x7f23d4199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.009+0000 7f23d3fff640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d4101420 0x7f23d4199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23d92ea640 1 -- 172.21.15.73:0/1891379533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d4100a80 msgr2=0x7f23d4199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23d92ea640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d4100a80 0x7f23d4199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23d92ea640 1 -- 172.21.15.73:0/1891379533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d4101420 msgr2=0x7f23d4199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23d92ea640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d4101420 0x7f23d4199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23d92ea640 1 -- 172.21.15.73:0/1891379533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d41a49e0 con 0x7f23d4106a80 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23d92ea640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4106a80 0x7f23d41a44a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00b970 tx=0x7f23cc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:45.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23d1ffb640 1 -- 172.21.15.73:0/1891379533 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc019070 con 0x7f23d4106a80 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23d1ffb640 1 -- 172.21.15.73:0/1891379533 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23cc014440 con 0x7f23d4106a80 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d41a4bb0 con 0x7f23d4106a80 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23d1ffb640 1 -- 172.21.15.73:0/1891379533 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0075d0 con 0x7f23d4106a80 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.010+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41a5070 con 0x7f23d4106a80 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.011+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d4100f60 con 0x7f23d4106a80 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.012+0000 7f23d1ffb640 1 -- 172.21.15.73:0/1891379533 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f23cc01c070 con 0x7f23d4106a80 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.013+0000 7f23d1ffb640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f23c40a2c00 0x7f23c40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.013+0000 7f23d8ae9640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f23c40a2c00 0x7f23c40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.013+0000 7f23d1ffb640 1 -- 172.21.15.73:0/1891379533 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f23cc0ce4e0 con 0x7f23d4106a80 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.013+0000 7f23d8ae9640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f23c40a2c00 0x7f23c40a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009990 tx=0x7f23c8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.017+0000 7f23d1ffb640 1 -- 172.21.15.73:0/1891379533 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23cc09b570 con 0x7f23d4106a80 2024-09-10T07:47:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.183+0000 7f23d1ffb640 1 -- 172.21.15.73:0/1891379533 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f23cc0974e0 con 0x7f23d4106a80 2024-09-10T07:47:45.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.220+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f23d4109080 con 0x7f23c40a2c00 2024-09-10T07:47:45.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.246+0000 7f23d1ffb640 1 -- 172.21.15.73:0/1891379533 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f23c800e850 con 0x7f23c40a2c00 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f23c40a2c00 msgr2=0x7f23c40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f23c40a2c00 0x7f23c40a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009990 tx=0x7f23c8009110 comp rx=0 tx=0).stop 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4106a80 msgr2=0x7f23d41a44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4106a80 0x7f23d41a44a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00b970 tx=0x7f23cc00bd70 comp rx=0 tx=0).stop 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 shutdown_connections 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f23c40a2c00 0x7f23c40a50c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d4106a80 0x7f23d41a44a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d4101420 0x7f23d4199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 --2- 172.21.15.73:0/1891379533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d4100a80 0x7f23d4199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 >> 172.21.15.73:0/1891379533 conn(0x7f23d40fc7a0 msgr2=0x7f23d40fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:45.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 shutdown_connections 2024-09-10T07:47:45.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:45.248+0000 7f23dad4d640 1 -- 172.21.15.73:0/1891379533 wait complete. 2024-09-10T07:47:45.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-10T07:47:45.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-10T07:47:45.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-10T07:47:45.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-10T07:47:45.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-10T07:47:45.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-10T07:47:45.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]: dispatch 2024-09-10T07:47:45.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-10T07:47:45.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-09-10T07:47:45.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-10T07:47:45.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:45 smithi073 ceph-mon[30850]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T07:47:45.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-10T07:47:45.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-10T07:47:45.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-10T07:47:45.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-10T07:47:45.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-10T07:47:45.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-10T07:47:45.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]: dispatch 2024-09-10T07:47:45.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-10T07:47:45.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-09-10T07:47:45.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-10T07:47:45.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:45 smithi159 ceph-mon[35522]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T07:47:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-10T07:47:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-10T07:47:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-10T07:47:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-10T07:47:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-10T07:47:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-10T07:47:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]: dispatch 2024-09-10T07:47:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-10T07:47:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-09-10T07:47:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-10T07:47:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:45 smithi102 ceph-mon[35514]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T07:47:45.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T07:47:46.181 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:46.459 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T07:47:46.459 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-10T07:47:46.459 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-10T07:47:46.459 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-10T07:47:46.459 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T07:47:46.459 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-10T07:47:46.459 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-09-10T07:47:46.460 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-10T07:47:46.460 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-10T07:47:46.460 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-10T07:47:46.460 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T07:47:46.460 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T07:47:46.460 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:46 smithi073 ceph-mon[30850]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:46.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T07:47:46.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-10T07:47:46.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-10T07:47:46.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-10T07:47:46.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T07:47:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-10T07:47:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-09-10T07:47:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-10T07:47:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-10T07:47:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-10T07:47:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T07:47:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T07:47:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:46 smithi102 ceph-mon[35514]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T07:47:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-10T07:47:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-10T07:47:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-10T07:47:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T07:47:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-10T07:47:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-09-10T07:47:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-10T07:47:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-10T07:47:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-10T07:47:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T07:47:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T07:47:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:46 smithi159 ceph-mon[35522]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2196850472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4106f10 msgr2=0x7f3ea410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2196850472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4106f10 0x7f3ea410ea90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009ca0 tx=0x7f3e9c02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2196850472 shutdown_connections 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2196850472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4106f10 0x7f3ea410ea90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2196850472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ea4102790 0x7f3ea41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2196850472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea4101de0 0x7f3ea41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2196850472 >> 172.21.15.73:0/2196850472 conn(0x7f3ea40fd8c0 msgr2=0x7f3ea40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2196850472 shutdown_connections 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2196850472 wait complete. 2024-09-10T07:47:46.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 Processor -- start 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.668+0000 7f3eaa1a7640 1 -- start start 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3eaa1a7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4101de0 0x7f3ea41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3eaa1a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ea4102790 0x7f3ea4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3eaa1a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea4106f10 0x7f3ea419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3eaa1a7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4111f70 con 0x7f3ea4101de0 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3eaa1a7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4111df0 con 0x7f3ea4102790 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3eaa1a7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41120f0 con 0x7f3ea4106f10 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4101de0 0x7f3ea41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4101de0 0x7f3ea41983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57416/0 (socket says 172.21.15.73:57416) 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea37fe640 1 -- 172.21.15.73:0/2574103130 learned_addr learned my addr 172.21.15.73:0/2574103130 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea3fff640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea4106f10 0x7f3ea419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:46.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3e9bfff640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ea4102790 0x7f3ea4198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:46.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea37fe640 1 -- 172.21.15.73:0/2574103130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea4106f10 msgr2=0x7f3ea419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:46.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea37fe640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea4106f10 0x7f3ea419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea37fe640 1 -- 172.21.15.73:0/2574103130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ea4102790 msgr2=0x7f3ea4198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:46.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea37fe640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ea4102790 0x7f3ea4198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea37fe640 1 -- 172.21.15.73:0/2574103130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea419d380 con 0x7f3ea4101de0 2024-09-10T07:47:46.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3e9bfff640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ea4102790 0x7f3ea4198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:47:46.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea3fff640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea4106f10 0x7f3ea419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea37fe640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4101de0 0x7f3ea41983d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400d770 tx=0x7f3e9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea17fa640 1 -- 172.21.15.73:0/2574103130 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94017070 con 0x7f3ea4101de0 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea17fa640 1 -- 172.21.15.73:0/2574103130 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e94005500 con 0x7f3ea4101de0 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea419d670 con 0x7f3ea4101de0 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3ea17fa640 1 -- 172.21.15.73:0/2574103130 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94004e00 con 0x7f3ea4101de0 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.669+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea41a4f50 con 0x7f3ea4101de0 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.670+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea41021c0 con 0x7f3ea4101de0 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.671+0000 7f3ea17fa640 1 -- 172.21.15.73:0/2574103130 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3e94004fa0 con 0x7f3ea4101de0 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.672+0000 7f3ea17fa640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3e900a2c10 0x7f3e900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.672+0000 7f3e9bfff640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3e900a2c10 0x7f3e900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:46.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.672+0000 7f3ea17fa640 1 -- 172.21.15.73:0/2574103130 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f3e940ced20 con 0x7f3ea4101de0 2024-09-10T07:47:46.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.673+0000 7f3e9bfff640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3e900a2c10 0x7f3e900a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c005fd0 tx=0x7f3e8c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:46.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.677+0000 7f3ea17fa640 1 -- 172.21.15.73:0/2574103130 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e9409bb00 con 0x7f3ea4101de0 2024-09-10T07:47:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.871+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f3ea410a1c0 con 0x7f3e900a2c10 2024-09-10T07:47:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.876+0000 7f3ea17fa640 1 -- 172.21.15.73:0/2574103130 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3e8c00bc40 con 0x7f3e900a2c10 2024-09-10T07:47:46.875 INFO:teuthology.orchestra.run.smithi073.stdout:/volumes/qa/sv_0/fd02fe08-2faf-4caf-b96b-faa847ea3990 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3e900a2c10 msgr2=0x7f3e900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3e900a2c10 0x7f3e900a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c005fd0 tx=0x7f3e8c005850 comp rx=0 tx=0).stop 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4101de0 msgr2=0x7f3ea41983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4101de0 0x7f3ea41983d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400d770 tx=0x7f3e9400dc30 comp rx=0 tx=0).stop 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 shutdown_connections 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f3e900a2c10 0x7f3e900a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea4106f10 0x7f3ea419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ea4102790 0x7f3ea4198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 --2- 172.21.15.73:0/2574103130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea4101de0 0x7f3ea41983d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 >> 172.21.15.73:0/2574103130 conn(0x7f3ea40fd8c0 msgr2=0x7f3ea40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 shutdown_connections 2024-09-10T07:47:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:46.878+0000 7f3eaa1a7640 1 -- 172.21.15.73:0/2574103130 wait complete. 2024-09-10T07:47:47.461 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:47 smithi073 ceph-mon[30850]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T07:47:47.461 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:47 smithi073 ceph-mon[30850]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-10T07:47:47.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T07:47:47.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:47 smithi102 ceph-mon[35514]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T07:47:47.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:47 smithi102 ceph-mon[35514]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-10T07:47:47.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:47 smithi159 ceph-mon[35522]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T07:47:47.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:47 smithi159 ceph-mon[35522]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-10T07:47:47.742 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 -- 172.21.15.73:0/631175332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102570 msgr2=0x7f2b501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 --2- 172.21.15.73:0/631175332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102570 0x7f2b501029b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009900 tx=0x7f2b4c02a480 comp rx=0 tx=0).stop 2024-09-10T07:47:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 -- 172.21.15.73:0/631175332 shutdown_connections 2024-09-10T07:47:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 --2- 172.21.15.73:0/631175332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b50102ef0 0x7f2b5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 --2- 172.21.15.73:0/631175332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102570 0x7f2b501029b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 --2- 172.21.15.73:0/631175332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b50100e20 0x7f2b50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 -- 172.21.15.73:0/631175332 >> 172.21.15.73:0/631175332 conn(0x7f2b500fc7d0 msgr2=0x7f2b500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 -- 172.21.15.73:0/631175332 shutdown_connections 2024-09-10T07:47:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 -- 172.21.15.73:0/631175332 wait complete. 2024-09-10T07:47:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 Processor -- start 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.220+0000 7f2b57a29640 1 -- start start 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b57a29640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b50100e20 0x7f2b501985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b57a29640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b50102570 0x7f2b50198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b57a29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102ef0 0x7f2b5019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b57a29640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50110f80 con 0x7f2b50102ef0 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b57a29640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50110e00 con 0x7f2b50102570 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b57a29640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50111100 con 0x7f2b50100e20 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b55fc6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102ef0 0x7f2b5019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b55fc6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102ef0 0x7f2b5019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57436/0 (socket says 172.21.15.73:57436) 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b54fc4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b50102570 0x7f2b50198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b55fc6640 1 -- 172.21.15.73:0/1792266919 learned_addr learned my addr 172.21.15.73:0/1792266919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b557c5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b50100e20 0x7f2b501985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b55fc6640 1 -- 172.21.15.73:0/1792266919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b50100e20 msgr2=0x7f2b501985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b55fc6640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b50100e20 0x7f2b501985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b55fc6640 1 -- 172.21.15.73:0/1792266919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b50102570 msgr2=0x7f2b50198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b55fc6640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b50102570 0x7f2b50198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b55fc6640 1 -- 172.21.15.73:0/1792266919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5019d560 con 0x7f2b50102ef0 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b55fc6640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102ef0 0x7f2b5019ce80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800cad0 tx=0x7f2b4800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b427fc640 1 -- 172.21.15.73:0/1792266919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800ae20 con 0x7f2b50102ef0 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.221+0000 7f2b427fc640 1 -- 172.21.15.73:0/1792266919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b48005020 con 0x7f2b50102ef0 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.222+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5019d850 con 0x7f2b50102ef0 2024-09-10T07:47:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.222+0000 7f2b427fc640 1 -- 172.21.15.73:0/1792266919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800f6f0 con 0x7f2b50102ef0 2024-09-10T07:47:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.222+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b501a5130 con 0x7f2b50102ef0 2024-09-10T07:47:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.223+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b50101200 con 0x7f2b50102ef0 2024-09-10T07:47:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.224+0000 7f2b427fc640 1 -- 172.21.15.73:0/1792266919 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2b480051d0 con 0x7f2b50102ef0 2024-09-10T07:47:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.224+0000 7f2b427fc640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2b3c0a2c90 0x7f2b3c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.224+0000 7f2b557c5640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2b3c0a2c90 0x7f2b3c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.224+0000 7f2b427fc640 1 -- 172.21.15.73:0/1792266919 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f2b480cf0c0 con 0x7f2b50102ef0 2024-09-10T07:47:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.225+0000 7f2b557c5640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2b3c0a2c90 0x7f2b3c0a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b44005fd0 tx=0x7f2b4400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.228+0000 7f2b427fc640 1 -- 172.21.15.73:0/1792266919 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b48014030 con 0x7f2b50102ef0 2024-09-10T07:47:48.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.418+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2b50062630 con 0x7f2b3c0a2c90 2024-09-10T07:47:48.418 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:48 smithi073 ceph-mon[30850]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:48.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.441+0000 7f2b427fc640 1 -- 172.21.15.73:0/1792266919 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2b50062630 con 0x7f2b3c0a2c90 2024-09-10T07:47:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.443+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2b3c0a2c90 msgr2=0x7f2b3c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.443+0000 7f2b57a29640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2b3c0a2c90 0x7f2b3c0a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b44005fd0 tx=0x7f2b4400b390 comp rx=0 tx=0).stop 2024-09-10T07:47:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102ef0 msgr2=0x7f2b5019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102ef0 0x7f2b5019ce80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800cad0 tx=0x7f2b4800cf90 comp rx=0 tx=0).stop 2024-09-10T07:47:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 shutdown_connections 2024-09-10T07:47:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2b3c0a2c90 0x7f2b3c0a5150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b50102ef0 0x7f2b5019ce80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b50102570 0x7f2b50198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 --2- 172.21.15.73:0/1792266919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b50100e20 0x7f2b501985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 >> 172.21.15.73:0/1792266919 conn(0x7f2b500fc7d0 msgr2=0x7f2b5006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 shutdown_connections 2024-09-10T07:47:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:48.444+0000 7f2b57a29640 1 -- 172.21.15.73:0/1792266919 wait complete. 2024-09-10T07:47:48.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:48 smithi102 ceph-mon[35514]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:48.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:48 smithi159 ceph-mon[35522]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:49.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T07:47:49.398 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:49.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:49 smithi073 ceph-mon[30850]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:49.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:49 smithi073 ceph-mon[30850]: pgmap v285: 97 pgs: 97 active+clean; 604 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.5 KiB/s wr, 4 op/s 2024-09-10T07:47:49.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:49 smithi102 ceph-mon[35514]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:49.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:49 smithi102 ceph-mon[35514]: pgmap v285: 97 pgs: 97 active+clean; 604 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.5 KiB/s wr, 4 op/s 2024-09-10T07:47:49.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:49 smithi159 ceph-mon[35522]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:49.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:49 smithi159 ceph-mon[35522]: pgmap v285: 97 pgs: 97 active+clean; 604 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.5 KiB/s wr, 4 op/s 2024-09-10T07:47:49.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 -- 172.21.15.73:0/3874378317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 msgr2=0x7f95901021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 --2- 172.21.15.73:0/3874378317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 0x7f95901021d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9580009900 tx=0x7f958002a410 comp rx=0 tx=0).stop 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 -- 172.21.15.73:0/3874378317 shutdown_connections 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 --2- 172.21.15.73:0/3874378317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9590106f20 0x7f959010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 --2- 172.21.15.73:0/3874378317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95901027a0 0x7f95901067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 --2- 172.21.15.73:0/3874378317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 0x7f95901021d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 -- 172.21.15.73:0/3874378317 >> 172.21.15.73:0/3874378317 conn(0x7f95900fd8f0 msgr2=0x7f95900ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 -- 172.21.15.73:0/3874378317 shutdown_connections 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 -- 172.21.15.73:0/3874378317 wait complete. 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 Processor -- start 2024-09-10T07:47:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.876+0000 7f9596a2a640 1 -- start start 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f9596a2a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 0x7f95900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f9596a2a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95901027a0 0x7f9590074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f9596a2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590106f20 0x7f9590074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f9596a2a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9590111f80 con 0x7f9590101df0 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f9596a2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9590111e00 con 0x7f9590106f20 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f9596a2a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9590112100 con 0x7f95901027a0 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 0x7f95900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 0x7f95900744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57448/0 (socket says 172.21.15.73:57448) 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958ffff640 1 -- 172.21.15.73:0/2551545053 learned_addr learned my addr 172.21.15.73:0/2551545053 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f9594fc7640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590106f20 0x7f9590074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:49.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958f7fe640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95901027a0 0x7f9590074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958ffff640 1 -- 172.21.15.73:0/2551545053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95901027a0 msgr2=0x7f9590074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958ffff640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95901027a0 0x7f9590074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958ffff640 1 -- 172.21.15.73:0/2551545053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590106f20 msgr2=0x7f9590074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958ffff640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590106f20 0x7f9590074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958ffff640 1 -- 172.21.15.73:0/2551545053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95901a6880 con 0x7f9590101df0 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958f7fe640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95901027a0 0x7f9590074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958ffff640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 0x7f95900744f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9580006010 tx=0x7f95800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.877+0000 7f958d7fa640 1 -- 172.21.15.73:0/2551545053 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958003f030 con 0x7f9590101df0 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.878+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95901a6b10 con 0x7f9590101df0 2024-09-10T07:47:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.878+0000 7f958d7fa640 1 -- 172.21.15.73:0/2551545053 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9580003ce0 con 0x7f9590101df0 2024-09-10T07:47:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.878+0000 7f958d7fa640 1 -- 172.21.15.73:0/2551545053 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580035070 con 0x7f9590101df0 2024-09-10T07:47:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.878+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95901a7040 con 0x7f9590101df0 2024-09-10T07:47:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.879+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95901021d0 con 0x7f9590101df0 2024-09-10T07:47:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.880+0000 7f958d7fa640 1 -- 172.21.15.73:0/2551545053 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9580042030 con 0x7f9590101df0 2024-09-10T07:47:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.880+0000 7f958d7fa640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f95780a2c10 0x7f95780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.880+0000 7f958f7fe640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f95780a2c10 0x7f95780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.881+0000 7f958d7fa640 1 -- 172.21.15.73:0/2551545053 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f95800ef400 con 0x7f9590101df0 2024-09-10T07:47:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.881+0000 7f958f7fe640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f95780a2c10 0x7f95780a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9590075f80 tx=0x7f9584005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:49.884+0000 7f958d7fa640 1 -- 172.21.15.73:0/2551545053 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95800bc1e0 con 0x7f9590101df0 2024-09-10T07:47:50.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.076+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f9590062630 con 0x7f95780a2c10 2024-09-10T07:47:50.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.081+0000 7f958d7fa640 1 -- 172.21.15.73:0/2551545053 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f9590062630 con 0x7f95780a2c10 2024-09-10T07:47:50.081 INFO:teuthology.orchestra.run.smithi073.stdout:/volumes/qa/sv_1/281d3ef3-71e1-446c-a012-5b93ad7133e6 2024-09-10T07:47:50.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.083+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f95780a2c10 msgr2=0x7f95780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:50.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.083+0000 7f9596a2a640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f95780a2c10 0x7f95780a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9590075f80 tx=0x7f9584005e50 comp rx=0 tx=0).stop 2024-09-10T07:47:50.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.083+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 msgr2=0x7f95900744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:50.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.084+0000 7f9596a2a640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 0x7f95900744f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9580006010 tx=0x7f95800042f0 comp rx=0 tx=0).stop 2024-09-10T07:47:50.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.084+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 shutdown_connections 2024-09-10T07:47:50.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.084+0000 7f9596a2a640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f95780a2c10 0x7f95780a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:50.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.084+0000 7f9596a2a640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590106f20 0x7f9590074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.084+0000 7f9596a2a640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95901027a0 0x7f9590074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.084+0000 7f9596a2a640 1 --2- 172.21.15.73:0/2551545053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9590101df0 0x7f95900744f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.084+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 >> 172.21.15.73:0/2551545053 conn(0x7f95900fd8f0 msgr2=0x7f95900fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.084+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 shutdown_connections 2024-09-10T07:47:50.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:50.084+0000 7f9596a2a640 1 -- 172.21.15.73:0/2551545053 wait complete. 2024-09-10T07:47:50.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:47:51.044 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 -- 172.21.15.73:0/836246474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 msgr2=0x7fee681067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 --2- 172.21.15.73:0/836246474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 0x7fee681067e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fee58009900 tx=0x7fee5802a410 comp rx=0 tx=0).stop 2024-09-10T07:47:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 -- 172.21.15.73:0/836246474 shutdown_connections 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 --2- 172.21.15.73:0/836246474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee68106f10 0x7fee6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 --2- 172.21.15.73:0/836246474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 0x7fee681067e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 --2- 172.21.15.73:0/836246474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee68101de0 0x7fee681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 -- 172.21.15.73:0/836246474 >> 172.21.15.73:0/836246474 conn(0x7fee680fd8c0 msgr2=0x7fee680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 -- 172.21.15.73:0/836246474 shutdown_connections 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 -- 172.21.15.73:0/836246474 wait complete. 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 Processor -- start 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.410+0000 7fee6fbda640 1 -- start start 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6fbda640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee68101de0 0x7fee680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6fbda640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 0x7fee68074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6fbda640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee68106f10 0x7fee68074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6fbda640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fee68111f30 con 0x7fee68102790 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6fbda640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fee68111db0 con 0x7fee68106f10 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6fbda640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee681120b0 con 0x7fee68101de0 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d175640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 0x7fee68074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d175640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 0x7fee68074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53048/0 (socket says 172.21.15.73:53048) 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d175640 1 -- 172.21.15.73:0/4005437661 learned_addr learned my addr 172.21.15.73:0/4005437661 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d976640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee68101de0 0x7fee680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6e177640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee68106f10 0x7fee68074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d175640 1 -- 172.21.15.73:0/4005437661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee68101de0 msgr2=0x7fee680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d175640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee68101de0 0x7fee680744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d175640 1 -- 172.21.15.73:0/4005437661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee68106f10 msgr2=0x7fee68074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d175640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee68106f10 0x7fee68074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d175640 1 -- 172.21.15.73:0/4005437661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee681a6870 con 0x7fee68102790 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6d175640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 0x7fee68074a30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee58006010 tx=0x7fee580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee5effd640 1 -- 172.21.15.73:0/4005437661 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5803f030 con 0x7fee68102790 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee5effd640 1 -- 172.21.15.73:0/4005437661 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee58003ce0 con 0x7fee68102790 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee681a6b00 con 0x7fee68102790 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee5effd640 1 -- 172.21.15.73:0/4005437661 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58035070 con 0x7fee68102790 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.411+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee681a6fe0 con 0x7fee68102790 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.412+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee681021c0 con 0x7fee68102790 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.414+0000 7fee5effd640 1 -- 172.21.15.73:0/4005437661 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fee58042030 con 0x7fee68102790 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.414+0000 7fee5effd640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee540a2c10 0x7fee540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.414+0000 7fee6d976640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee540a2c10 0x7fee540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.414+0000 7fee5effd640 1 -- 172.21.15.73:0/4005437661 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fee580ef8e0 con 0x7fee68102790 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.415+0000 7fee6d976640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee540a2c10 0x7fee540a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee6400abe0 tx=0x7fee6400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.417+0000 7fee5effd640 1 -- 172.21.15.73:0/4005437661 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee580bc6c0 con 0x7fee68102790 2024-09-10T07:47:51.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.620+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee6810a0f0 con 0x7fee68102790 2024-09-10T07:47:51.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.621+0000 7fee5effd640 1 -- 172.21.15.73:0/4005437661 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11853 (secure 0 0 0) 0x7fee580bbfc0 con 0x7fee68102790 2024-09-10T07:47:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:51.620 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"btime":"2024-09-10T07:47:42:148674+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T07:47:32.394994+0000","modified":"2024-09-10T07:47:41.846317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6839/330469529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":330469529},{"type":"v1","addr":"172.21.15.102:6839","nonce":330469529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-10T07:47:51.621 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-10T07:47:51.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee540a2c10 msgr2=0x7fee540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:51.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee540a2c10 0x7fee540a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee6400abe0 tx=0x7fee6400a2d0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 msgr2=0x7fee68074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:51.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 0x7fee68074a30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee58006010 tx=0x7fee580042f0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 shutdown_connections 2024-09-10T07:47:51.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee540a2c10 0x7fee540a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee68106f10 0x7fee68074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee68102790 0x7fee68074a30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 --2- 172.21.15.73:0/4005437661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee68101de0 0x7fee680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:51.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 >> 172.21.15.73:0/4005437661 conn(0x7fee680fd8c0 msgr2=0x7fee680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:51.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 shutdown_connections 2024-09-10T07:47:51.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:51.623+0000 7fee6fbda640 1 -- 172.21.15.73:0/4005437661 wait complete. 2024-09-10T07:47:51.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:51 smithi073 ceph-mon[30850]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:51.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:51 smithi073 ceph-mon[30850]: pgmap v286: 97 pgs: 97 active+clean; 604 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 4 op/s; 72 B/s, 0 objects/s recovering 2024-09-10T07:47:51.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:51 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4005437661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:51 smithi102 ceph-mon[35514]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:51 smithi102 ceph-mon[35514]: pgmap v286: 97 pgs: 97 active+clean; 604 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 4 op/s; 72 B/s, 0 objects/s recovering 2024-09-10T07:47:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:51 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/4005437661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:51 smithi159 ceph-mon[35522]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:47:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:51 smithi159 ceph-mon[35522]: pgmap v286: 97 pgs: 97 active+clean; 604 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 4 op/s; 72 B/s, 0 objects/s recovering 2024-09-10T07:47:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:51 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/4005437661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:47:52.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T07:47:52.578 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:53.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.026+0000 7f5a11529640 1 -- 172.21.15.73:0/1178140228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 msgr2=0x7f5a0c106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.026+0000 7f5a11529640 1 --2- 172.21.15.73:0/1178140228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 0x7f5a0c106e40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f59fc009930 tx=0x7f59fc02a420 comp rx=0 tx=0).stop 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.026+0000 7f5a11529640 1 -- 172.21.15.73:0/1178140228 shutdown_connections 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.026+0000 7f5a11529640 1 --2- 172.21.15.73:0/1178140228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0c101400 0x7f5a0c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.026+0000 7f5a11529640 1 --2- 172.21.15.73:0/1178140228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a0c100a60 0x7f5a0c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.026+0000 7f5a11529640 1 --2- 172.21.15.73:0/1178140228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 0x7f5a0c106e40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.026+0000 7f5a11529640 1 -- 172.21.15.73:0/1178140228 >> 172.21.15.73:0/1178140228 conn(0x7f5a0c0fc780 msgr2=0x7f5a0c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.026+0000 7f5a11529640 1 -- 172.21.15.73:0/1178140228 shutdown_connections 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.026+0000 7f5a11529640 1 -- 172.21.15.73:0/1178140228 wait complete. 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a11529640 1 Processor -- start 2024-09-10T07:47:53.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a11529640 1 -- start start 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a11529640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0c100a60 0x7f5a0c102630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a11529640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a0c101400 0x7f5a0c102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a11529640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 0x7f5a0c1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a11529640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c110f00 con 0x7f5a0c106a60 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a11529640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c110d80 con 0x7f5a0c101400 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a11529640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c111080 con 0x7f5a0c100a60 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a0b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 0x7f5a0c1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a0b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 0x7f5a0c1030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53066/0 (socket says 172.21.15.73:53066) 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2796139559 learned_addr learned my addr 172.21.15.73:0/2796139559 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:53.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a0affd640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0c100a60 0x7f5a0c102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2796139559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0c100a60 msgr2=0x7f5a0c102630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a0b7fe640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0c100a60 0x7f5a0c102630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2796139559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a0c101400 msgr2=0x7f5a0c102b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a03fff640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a0c101400 0x7f5a0c102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a0b7fe640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a0c101400 0x7f5a0c102b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.027+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2796139559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c1a6ab0 con 0x7f5a0c106a60 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.028+0000 7f5a0b7fe640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 0x7f5a0c1030b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b970 tx=0x7f5a0400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.028+0000 7f5a08ff9640 1 -- 172.21.15.73:0/2796139559 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04019070 con 0x7f5a0c106a60 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.028+0000 7f5a08ff9640 1 -- 172.21.15.73:0/2796139559 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a0400cb40 con 0x7f5a0c106a60 2024-09-10T07:47:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.028+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0c1a6da0 con 0x7f5a0c106a60 2024-09-10T07:47:53.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.028+0000 7f5a08ff9640 1 -- 172.21.15.73:0/2796139559 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04007650 con 0x7f5a0c106a60 2024-09-10T07:47:53.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.028+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a0c1a72b0 con 0x7f5a0c106a60 2024-09-10T07:47:53.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.029+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a0c100f40 con 0x7f5a0c106a60 2024-09-10T07:47:53.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.030+0000 7f5a08ff9640 1 -- 172.21.15.73:0/2796139559 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5a0401c070 con 0x7f5a0c106a60 2024-09-10T07:47:53.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.031+0000 7f5a08ff9640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f59f80a2c10 0x7f59f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:53.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.031+0000 7f5a0affd640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f59f80a2c10 0x7f59f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:53.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.031+0000 7f5a08ff9640 1 -- 172.21.15.73:0/2796139559 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f5a040ce6e0 con 0x7f5a0c106a60 2024-09-10T07:47:53.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.031+0000 7f5a0affd640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f59f80a2c10 0x7f59f80a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0096c0 tx=0x7f59fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:53.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.035+0000 7f5a08ff9640 1 -- 172.21.15.73:0/2796139559 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a0409b5d0 con 0x7f5a0c106a60 2024-09-10T07:47:53.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.201+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a0c1a7610 con 0x7f5a0c106a60 2024-09-10T07:47:53.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.203+0000 7f5a08ff9640 1 -- 172.21.15.73:0/2796139559 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22859 (secure 0 0 0) 0x7f5a0409aed0 con 0x7f5a0c106a60 2024-09-10T07:47:53.204 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:53.204 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":83,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:47:46.168838+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:47:28.792230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:47:30.666653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:47:53.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f59f80a2c10 msgr2=0x7f59f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:53.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f59f80a2c10 0x7f59f80a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0096c0 tx=0x7f59fc000bc0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 msgr2=0x7f5a0c1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:53.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 0x7f5a0c1030b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b970 tx=0x7f5a0400be30 comp rx=0 tx=0).stop 2024-09-10T07:47:53.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 shutdown_connections 2024-09-10T07:47:53.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f59f80a2c10 0x7f59f80a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a0c106a60 0x7f5a0c1030b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a0c101400 0x7f5a0c102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 --2- 172.21.15.73:0/2796139559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0c100a60 0x7f5a0c102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:53.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 >> 172.21.15.73:0/2796139559 conn(0x7f5a0c0fc780 msgr2=0x7f5a0c104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:53.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 shutdown_connections 2024-09-10T07:47:53.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:53.205+0000 7f5a11529640 1 -- 172.21.15.73:0/2796139559 wait complete. 2024-09-10T07:47:53.808 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:53 smithi073 ceph-mon[30850]: pgmap v287: 97 pgs: 97 active+clean; 604 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.0 KiB/s wr, 3 op/s; 72 B/s, 0 objects/s recovering 2024-09-10T07:47:53.808 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:53 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2796139559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:47:53.835 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T07:47:53.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T07:47:54.080 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:53 smithi102 ceph-mon[35514]: pgmap v287: 97 pgs: 97 active+clean; 604 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.0 KiB/s wr, 3 op/s; 72 B/s, 0 objects/s recovering 2024-09-10T07:47:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:53 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2796139559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:47:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:53 smithi159 ceph-mon[35522]: pgmap v287: 97 pgs: 97 active+clean; 604 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.0 KiB/s wr, 3 op/s; 72 B/s, 0 objects/s recovering 2024-09-10T07:47:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:53 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2796139559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:47:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 -- 172.21.15.73:0/3971713504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430101420 msgr2=0x7f043010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 --2- 172.21.15.73:0/3971713504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430101420 0x7f043010d950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0428009cd0 tx=0x7f042802a8e0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 -- 172.21.15.73:0/3971713504 shutdown_connections 2024-09-10T07:47:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 --2- 172.21.15.73:0/3971713504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430101420 0x7f043010d950 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 --2- 172.21.15.73:0/3971713504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0430100a80 0x7f0430100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 --2- 172.21.15.73:0/3971713504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0430106a80 0x7f0430106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 -- 172.21.15.73:0/3971713504 >> 172.21.15.73:0/3971713504 conn(0x7f04300fc7a0 msgr2=0x7f04300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 -- 172.21.15.73:0/3971713504 shutdown_connections 2024-09-10T07:47:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 -- 172.21.15.73:0/3971713504 wait complete. 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 Processor -- start 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.540+0000 7f04371e2640 1 -- start start 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f04371e2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0430100a80 0x7f0430199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f04371e2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0430101420 0x7f0430199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f04371e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430106a80 0x7f04301a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f04371e2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0430110e80 con 0x7f0430106a80 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f04371e2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0430110d00 con 0x7f0430101420 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f04371e2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0430111000 con 0x7f0430100a80 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f043577f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430106a80 0x7f04301a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f043577f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430106a80 0x7f04301a4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53092/0 (socket says 172.21.15.73:53092) 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f043577f640 1 -- 172.21.15.73:0/1694408674 learned_addr learned my addr 172.21.15.73:0/1694408674 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f0434f7e640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0430100a80 0x7f0430199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f042ffff640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0430101420 0x7f0430199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f043577f640 1 -- 172.21.15.73:0/1694408674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0430100a80 msgr2=0x7f0430199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f043577f640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0430100a80 0x7f0430199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f043577f640 1 -- 172.21.15.73:0/1694408674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0430101420 msgr2=0x7f0430199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f043577f640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0430101420 0x7f0430199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f043577f640 1 -- 172.21.15.73:0/1694408674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04301a47d0 con 0x7f0430106a80 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f0434f7e640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0430100a80 0x7f0430199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:47:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f042ffff640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0430101420 0x7f0430199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f043577f640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430106a80 0x7f04301a4290 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0428005cc0 tx=0x7f0428003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.541+0000 7f042dffb640 1 -- 172.21.15.73:0/1694408674 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428004040 con 0x7f0430106a80 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.542+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04301a49a0 con 0x7f0430106a80 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.542+0000 7f042dffb640 1 -- 172.21.15.73:0/1694408674 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04280046c0 con 0x7f0430106a80 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.542+0000 7f042dffb640 1 -- 172.21.15.73:0/1694408674 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428046480 con 0x7f0430106a80 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.542+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04301a4ed0 con 0x7f0430106a80 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.543+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0430100ee0 con 0x7f0430106a80 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.545+0000 7f042dffb640 1 -- 172.21.15.73:0/1694408674 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f04280305a0 con 0x7f0430106a80 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.545+0000 7f042dffb640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04200a2c10 0x7f04200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.545+0000 7f0434f7e640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04200a2c10 0x7f04200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.545+0000 7f042dffb640 1 -- 172.21.15.73:0/1694408674 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f042802e030 con 0x7f0430106a80 2024-09-10T07:47:54.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.546+0000 7f0434f7e640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04200a2c10 0x7f04200a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0424005d00 tx=0x7f042400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:54.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.548+0000 7f042dffb640 1 -- 172.21.15.73:0/1694408674 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f042804b060 con 0x7f0430106a80 2024-09-10T07:47:54.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.714+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04300fe5c0 con 0x7f04200a2c10 2024-09-10T07:47:54.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.720+0000 7f042dffb640 1 -- 172.21.15.73:0/1694408674 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258644 (secure 0 0 0) 0x7f04300fe5c0 con 0x7f04200a2c10 2024-09-10T07:47:54.724 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:54.725 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-10T07:47:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04200a2c10 msgr2=0x7f04200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04200a2c10 0x7f04200a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0424005d00 tx=0x7f042400b410 comp rx=0 tx=0).stop 2024-09-10T07:47:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430106a80 msgr2=0x7f04301a4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430106a80 0x7f04301a4290 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0428005cc0 tx=0x7f0428003970 comp rx=0 tx=0).stop 2024-09-10T07:47:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 shutdown_connections 2024-09-10T07:47:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04200a2c10 0x7f04200a50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0430106a80 0x7f04301a4290 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0430101420 0x7f0430199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 --2- 172.21.15.73:0/1694408674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0430100a80 0x7f0430199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.723+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 >> 172.21.15.73:0/1694408674 conn(0x7f04300fc7a0 msgr2=0x7f04300fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.724+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 shutdown_connections 2024-09-10T07:47:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:54.724+0000 7f04371e2640 1 -- 172.21.15.73:0/1694408674 wait complete. 2024-09-10T07:47:55.412 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-10T07:47:54.664506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":171,"num_read_kb":177,"num_write":260,"num_write_kb":3016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353548,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588276,"statfs":{"total":1151940427776,"available":1151578394624,"internally_reserved":0,"allocated":12890112,"data_stored":7209249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51789,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":47,"num_write":34,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.494628"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174321+0000","last_change":"2024-09-10T07:47:31.876663+0000","last_active":"2024-09-10T07:47:46.174321+0000","last_peered":"2024-09-10T07:47:46.174321+0000","last_clean":"2024-09-10T07:47:46.174321+0000","last_became_active":"2024-09-10T07:47:31.876368+0000","last_became_peered":"2024-09-10T07:47:31.876368+0000","last_unstale":"2024-09-10T07:47:46.174321+0000","last_undegraded":"2024-09-10T07:47:46.174321+0000","last_fullsized":"2024-09-10T07:47:46.174321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:30.203753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176341+0000","last_change":"2024-09-10T07:47:31.867862+0000","last_active":"2024-09-10T07:47:46.176341+0000","last_peered":"2024-09-10T07:47:46.176341+0000","last_clean":"2024-09-10T07:47:46.176341+0000","last_became_active":"2024-09-10T07:47:31.867553+0000","last_became_peered":"2024-09-10T07:47:31.867553+0000","last_unstale":"2024-09-10T07:47:46.176341+0000","last_undegraded":"2024-09-10T07:47:46.176341+0000","last_fullsized":"2024-09-10T07:47:46.176341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:02.809443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176241+0000","last_change":"2024-09-10T07:47:31.873697+0000","last_active":"2024-09-10T07:47:46.176241+0000","last_peered":"2024-09-10T07:47:46.176241+0000","last_clean":"2024-09-10T07:47:46.176241+0000","last_became_active":"2024-09-10T07:47:31.873156+0000","last_became_peered":"2024-09-10T07:47:31.873156+0000","last_unstale":"2024-09-10T07:47:46.176241+0000","last_undegraded":"2024-09-10T07:47:46.176241+0000","last_fullsized":"2024-09-10T07:47:46.176241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:16.365317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192901+0000","last_change":"2024-09-10T07:47:31.869749+0000","last_active":"2024-09-10T07:47:46.192901+0000","last_peered":"2024-09-10T07:47:46.192901+0000","last_clean":"2024-09-10T07:47:46.192901+0000","last_became_active":"2024-09-10T07:47:31.868474+0000","last_became_peered":"2024-09-10T07:47:31.868474+0000","last_unstale":"2024-09-10T07:47:46.192901+0000","last_undegraded":"2024-09-10T07:47:46.192901+0000","last_fullsized":"2024-09-10T07:47:46.192901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:49.809017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177905+0000","last_change":"2024-09-10T07:47:31.864160+0000","last_active":"2024-09-10T07:47:46.177905+0000","last_peered":"2024-09-10T07:47:46.177905+0000","last_clean":"2024-09-10T07:47:46.177905+0000","last_became_active":"2024-09-10T07:47:31.862214+0000","last_became_peered":"2024-09-10T07:47:31.862214+0000","last_unstale":"2024-09-10T07:47:46.177905+0000","last_undegraded":"2024-09-10T07:47:46.177905+0000","last_fullsized":"2024-09-10T07:47:46.177905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:50.422218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.194241+0000","last_change":"2024-09-10T07:47:46.194241+0000","last_active":"2024-09-10T07:47:46.194241+0000","last_peered":"2024-09-10T07:47:46.194241+0000","last_clean":"2024-09-10T07:47:46.194241+0000","last_became_active":"2024-09-10T07:47:46.193667+0000","last_became_peered":"2024-09-10T07:47:46.193667+0000","last_unstale":"2024-09-10T07:47:46.194241+0000","last_undegraded":"2024-09-10T07:47:46.194241+0000","last_fullsized":"2024-09-10T07:47:46.194241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:05.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.193934+0000","last_change":"2024-09-10T07:47:46.193934+0000","last_active":"2024-09-10T07:47:46.193934+0000","last_peered":"2024-09-10T07:47:46.193934+0000","last_clean":"2024-09-10T07:47:46.193934+0000","last_became_active":"2024-09-10T07:47:46.193474+0000","last_became_peered":"2024-09-10T07:47:46.193474+0000","last_unstale":"2024-09-10T07:47:46.193934+0000","last_undegraded":"2024-09-10T07:47:46.193934+0000","last_fullsized":"2024-09-10T07:47:46.193934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:00.465345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171799+0000","last_change":"2024-09-10T07:47:31.871924+0000","last_active":"2024-09-10T07:47:46.171799+0000","last_peered":"2024-09-10T07:47:46.171799+0000","last_clean":"2024-09-10T07:47:46.171799+0000","last_became_active":"2024-09-10T07:47:31.871639+0000","last_became_peered":"2024-09-10T07:47:31.871639+0000","last_unstale":"2024-09-10T07:47:46.171799+0000","last_undegraded":"2024-09-10T07:47:46.171799+0000","last_fullsized":"2024-09-10T07:47:46.171799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:48.248506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173438+0000","last_change":"2024-09-10T07:47:31.876528+0000","last_active":"2024-09-10T07:47:46.173438+0000","last_peered":"2024-09-10T07:47:46.173438+0000","last_clean":"2024-09-10T07:47:46.173438+0000","last_became_active":"2024-09-10T07:47:31.876022+0000","last_became_peered":"2024-09-10T07:47:31.876022+0000","last_unstale":"2024-09-10T07:47:46.173438+0000","last_undegraded":"2024-09-10T07:47:46.173438+0000","last_fullsized":"2024-09-10T07:47:46.173438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:07.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177291+0000","last_change":"2024-09-10T07:47:31.864740+0000","last_active":"2024-09-10T07:47:46.177291+0000","last_peered":"2024-09-10T07:47:46.177291+0000","last_clean":"2024-09-10T07:47:46.177291+0000","last_became_active":"2024-09-10T07:47:31.864138+0000","last_became_peered":"2024-09-10T07:47:31.864138+0000","last_unstale":"2024-09-10T07:47:46.177291+0000","last_undegraded":"2024-09-10T07:47:46.177291+0000","last_fullsized":"2024-09-10T07:47:46.177291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:27.248169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174342+0000","last_change":"2024-09-10T07:47:31.875751+0000","last_active":"2024-09-10T07:47:46.174342+0000","last_peered":"2024-09-10T07:47:46.174342+0000","last_clean":"2024-09-10T07:47:46.174342+0000","last_became_active":"2024-09-10T07:47:31.875399+0000","last_became_peered":"2024-09-10T07:47:31.875399+0000","last_unstale":"2024-09-10T07:47:46.174342+0000","last_undegraded":"2024-09-10T07:47:46.174342+0000","last_fullsized":"2024-09-10T07:47:46.174342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:19.439947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192991+0000","last_change":"2024-09-10T07:47:31.870220+0000","last_active":"2024-09-10T07:47:46.192991+0000","last_peered":"2024-09-10T07:47:46.192991+0000","last_clean":"2024-09-10T07:47:46.192991+0000","last_became_active":"2024-09-10T07:47:31.869018+0000","last_became_peered":"2024-09-10T07:47:31.869018+0000","last_unstale":"2024-09-10T07:47:46.192991+0000","last_undegraded":"2024-09-10T07:47:46.192991+0000","last_fullsized":"2024-09-10T07:47:46.192991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:52.108972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192766+0000","last_change":"2024-09-10T07:47:31.868419+0000","last_active":"2024-09-10T07:47:46.192766+0000","last_peered":"2024-09-10T07:47:46.192766+0000","last_clean":"2024-09-10T07:47:46.192766+0000","last_became_active":"2024-09-10T07:47:31.868093+0000","last_became_peered":"2024-09-10T07:47:31.868093+0000","last_unstale":"2024-09-10T07:47:46.192766+0000","last_undegraded":"2024-09-10T07:47:46.192766+0000","last_fullsized":"2024-09-10T07:47:46.192766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:24.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176134+0000","last_change":"2024-09-10T07:47:31.866974+0000","last_active":"2024-09-10T07:47:46.176134+0000","last_peered":"2024-09-10T07:47:46.176134+0000","last_clean":"2024-09-10T07:47:46.176134+0000","last_became_active":"2024-09-10T07:47:31.866579+0000","last_became_peered":"2024-09-10T07:47:31.866579+0000","last_unstale":"2024-09-10T07:47:46.176134+0000","last_undegraded":"2024-09-10T07:47:46.176134+0000","last_fullsized":"2024-09-10T07:47:46.176134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:47.140259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.180225+0000","last_change":"2024-09-10T07:47:46.180225+0000","last_active":"2024-09-10T07:47:46.180225+0000","last_peered":"2024-09-10T07:47:46.180225+0000","last_clean":"2024-09-10T07:47:46.180225+0000","last_became_active":"2024-09-10T07:47:46.179885+0000","last_became_peered":"2024-09-10T07:47:46.179885+0000","last_unstale":"2024-09-10T07:47:46.180225+0000","last_undegraded":"2024-09-10T07:47:46.180225+0000","last_fullsized":"2024-09-10T07:47:46.180225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:00.796740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172587+0000","last_change":"2024-09-10T07:47:31.876926+0000","last_active":"2024-09-10T07:47:46.172587+0000","last_peered":"2024-09-10T07:47:46.172587+0000","last_clean":"2024-09-10T07:47:46.172587+0000","last_became_active":"2024-09-10T07:47:31.876620+0000","last_became_peered":"2024-09-10T07:47:31.876620+0000","last_unstale":"2024-09-10T07:47:46.172587+0000","last_undegraded":"2024-09-10T07:47:46.172587+0000","last_fullsized":"2024-09-10T07:47:46.172587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:53.863927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174354+0000","last_change":"2024-09-10T07:47:31.871088+0000","last_active":"2024-09-10T07:47:46.174354+0000","last_peered":"2024-09-10T07:47:46.174354+0000","last_clean":"2024-09-10T07:47:46.174354+0000","last_became_active":"2024-09-10T07:47:31.870709+0000","last_became_peered":"2024-09-10T07:47:31.870709+0000","last_unstale":"2024-09-10T07:47:46.174354+0000","last_undegraded":"2024-09-10T07:47:46.174354+0000","last_fullsized":"2024-09-10T07:47:46.174354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:34.964229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174874+0000","last_change":"2024-09-10T07:47:31.869310+0000","last_active":"2024-09-10T07:47:46.174874+0000","last_peered":"2024-09-10T07:47:46.174874+0000","last_clean":"2024-09-10T07:47:46.174874+0000","last_became_active":"2024-09-10T07:47:31.868892+0000","last_became_peered":"2024-09-10T07:47:31.868892+0000","last_unstale":"2024-09-10T07:47:46.174874+0000","last_undegraded":"2024-09-10T07:47:46.174874+0000","last_fullsized":"2024-09-10T07:47:46.174874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:15.338010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177118+0000","last_change":"2024-09-10T07:47:31.867938+0000","last_active":"2024-09-10T07:47:46.177118+0000","last_peered":"2024-09-10T07:47:46.177118+0000","last_clean":"2024-09-10T07:47:46.177118+0000","last_became_active":"2024-09-10T07:47:31.867556+0000","last_became_peered":"2024-09-10T07:47:31.867556+0000","last_unstale":"2024-09-10T07:47:46.177118+0000","last_undegraded":"2024-09-10T07:47:46.177118+0000","last_fullsized":"2024-09-10T07:47:46.177118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:43.198241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173966+0000","last_change":"2024-09-10T07:47:31.864157+0000","last_active":"2024-09-10T07:47:46.173966+0000","last_peered":"2024-09-10T07:47:46.173966+0000","last_clean":"2024-09-10T07:47:46.173966+0000","last_became_active":"2024-09-10T07:47:31.863802+0000","last_became_peered":"2024-09-10T07:47:31.863802+0000","last_unstale":"2024-09-10T07:47:46.173966+0000","last_undegraded":"2024-09-10T07:47:46.173966+0000","last_fullsized":"2024-09-10T07:47:46.173966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:03.492869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192857+0000","last_change":"2024-09-10T07:47:31.865404+0000","last_active":"2024-09-10T07:47:46.192857+0000","last_peered":"2024-09-10T07:47:46.192857+0000","last_clean":"2024-09-10T07:47:46.192857+0000","last_became_active":"2024-09-10T07:47:31.865098+0000","last_became_peered":"2024-09-10T07:47:31.865098+0000","last_unstale":"2024-09-10T07:47:46.192857+0000","last_undegraded":"2024-09-10T07:47:46.192857+0000","last_fullsized":"2024-09-10T07:47:46.192857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:56.111270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172776+0000","last_change":"2024-09-10T07:47:31.869880+0000","last_active":"2024-09-10T07:47:46.172776+0000","last_peered":"2024-09-10T07:47:46.172776+0000","last_clean":"2024-09-10T07:47:46.172776+0000","last_became_active":"2024-09-10T07:47:31.869535+0000","last_became_peered":"2024-09-10T07:47:31.869535+0000","last_unstale":"2024-09-10T07:47:46.172776+0000","last_undegraded":"2024-09-10T07:47:46.172776+0000","last_fullsized":"2024-09-10T07:47:46.172776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:53.157821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171861+0000","last_change":"2024-09-10T07:47:31.867799+0000","last_active":"2024-09-10T07:47:46.171861+0000","last_peered":"2024-09-10T07:47:46.171861+0000","last_clean":"2024-09-10T07:47:46.171861+0000","last_became_active":"2024-09-10T07:47:31.867499+0000","last_became_peered":"2024-09-10T07:47:31.867499+0000","last_unstale":"2024-09-10T07:47:46.171861+0000","last_undegraded":"2024-09-10T07:47:46.171861+0000","last_fullsized":"2024-09-10T07:47:46.171861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:47.340340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177625+0000","last_change":"2024-09-10T07:47:46.176635+0000","last_active":"2024-09-10T07:47:46.177625+0000","last_peered":"2024-09-10T07:47:46.177625+0000","last_clean":"2024-09-10T07:47:46.177625+0000","last_became_active":"2024-09-10T07:47:46.176225+0000","last_became_peered":"2024-09-10T07:47:46.176225+0000","last_unstale":"2024-09-10T07:47:46.177625+0000","last_undegraded":"2024-09-10T07:47:46.177625+0000","last_fullsized":"2024-09-10T07:47:46.177625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:33.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172991+0000","last_change":"2024-09-10T07:47:31.864776+0000","last_active":"2024-09-10T07:47:46.172991+0000","last_peered":"2024-09-10T07:47:46.172991+0000","last_clean":"2024-09-10T07:47:46.172991+0000","last_became_active":"2024-09-10T07:47:31.864446+0000","last_became_peered":"2024-09-10T07:47:31.864446+0000","last_unstale":"2024-09-10T07:47:46.172991+0000","last_undegraded":"2024-09-10T07:47:46.172991+0000","last_fullsized":"2024-09-10T07:47:46.172991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:38.976206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177130+0000","last_change":"2024-09-10T07:47:31.871688+0000","last_active":"2024-09-10T07:47:46.177130+0000","last_peered":"2024-09-10T07:47:46.177130+0000","last_clean":"2024-09-10T07:47:46.177130+0000","last_became_active":"2024-09-10T07:47:31.871484+0000","last_became_peered":"2024-09-10T07:47:31.871484+0000","last_unstale":"2024-09-10T07:47:46.177130+0000","last_undegraded":"2024-09-10T07:47:46.177130+0000","last_fullsized":"2024-09-10T07:47:46.177130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:53.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174171+0000","last_change":"2024-09-10T07:47:31.868919+0000","last_active":"2024-09-10T07:47:46.174171+0000","last_peered":"2024-09-10T07:47:46.174171+0000","last_clean":"2024-09-10T07:47:46.174171+0000","last_became_active":"2024-09-10T07:47:31.868593+0000","last_became_peered":"2024-09-10T07:47:31.868593+0000","last_unstale":"2024-09-10T07:47:46.174171+0000","last_undegraded":"2024-09-10T07:47:46.174171+0000","last_fullsized":"2024-09-10T07:47:46.174171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:02.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192808+0000","last_change":"2024-09-10T07:47:31.863674+0000","last_active":"2024-09-10T07:47:46.192808+0000","last_peered":"2024-09-10T07:47:46.192808+0000","last_clean":"2024-09-10T07:47:46.192808+0000","last_became_active":"2024-09-10T07:47:31.863347+0000","last_became_peered":"2024-09-10T07:47:31.863347+0000","last_unstale":"2024-09-10T07:47:46.192808+0000","last_undegraded":"2024-09-10T07:47:46.192808+0000","last_fullsized":"2024-09-10T07:47:46.192808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:55.819510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176196+0000","last_change":"2024-09-10T07:47:31.869710+0000","last_active":"2024-09-10T07:47:46.176196+0000","last_peered":"2024-09-10T07:47:46.176196+0000","last_clean":"2024-09-10T07:47:46.176196+0000","last_became_active":"2024-09-10T07:47:31.869284+0000","last_became_peered":"2024-09-10T07:47:31.869284+0000","last_unstale":"2024-09-10T07:47:46.176196+0000","last_undegraded":"2024-09-10T07:47:46.176196+0000","last_fullsized":"2024-09-10T07:47:46.176196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:49.128941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176605+0000","last_change":"2024-09-10T07:47:31.865576+0000","last_active":"2024-09-10T07:47:46.176605+0000","last_peered":"2024-09-10T07:47:46.176605+0000","last_clean":"2024-09-10T07:47:46.176605+0000","last_became_active":"2024-09-10T07:47:31.865225+0000","last_became_peered":"2024-09-10T07:47:31.865225+0000","last_unstale":"2024-09-10T07:47:46.176605+0000","last_undegraded":"2024-09-10T07:47:46.176605+0000","last_fullsized":"2024-09-10T07:47:46.176605+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:10.390091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176806+0000","last_change":"2024-09-10T07:47:31.869155+0000","last_active":"2024-09-10T07:47:46.176806+0000","last_peered":"2024-09-10T07:47:46.176806+0000","last_clean":"2024-09-10T07:47:46.176806+0000","last_became_active":"2024-09-10T07:47:31.868737+0000","last_became_peered":"2024-09-10T07:47:31.868737+0000","last_unstale":"2024-09-10T07:47:46.176806+0000","last_undegraded":"2024-09-10T07:47:46.176806+0000","last_fullsized":"2024-09-10T07:47:46.176806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:16.123687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173764+0000","last_change":"2024-09-10T07:47:31.870079+0000","last_active":"2024-09-10T07:47:46.173764+0000","last_peered":"2024-09-10T07:47:46.173764+0000","last_clean":"2024-09-10T07:47:46.173764+0000","last_became_active":"2024-09-10T07:47:31.869554+0000","last_became_peered":"2024-09-10T07:47:31.869554+0000","last_unstale":"2024-09-10T07:47:46.173764+0000","last_undegraded":"2024-09-10T07:47:46.173764+0000","last_fullsized":"2024-09-10T07:47:46.173764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:54.685962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177344+0000","last_change":"2024-09-10T07:47:31.867605+0000","last_active":"2024-09-10T07:47:46.177344+0000","last_peered":"2024-09-10T07:47:46.177344+0000","last_clean":"2024-09-10T07:47:46.177344+0000","last_became_active":"2024-09-10T07:47:31.867296+0000","last_became_peered":"2024-09-10T07:47:31.867296+0000","last_unstale":"2024-09-10T07:47:46.177344+0000","last_undegraded":"2024-09-10T07:47:46.177344+0000","last_fullsized":"2024-09-10T07:47:46.177344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:59.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172952+0000","last_change":"2024-09-10T07:47:29.862795+0000","last_active":"2024-09-10T07:47:46.172952+0000","last_peered":"2024-09-10T07:47:46.172952+0000","last_clean":"2024-09-10T07:47:46.172952+0000","last_became_active":"2024-09-10T07:47:29.862437+0000","last_became_peered":"2024-09-10T07:47:29.862437+0000","last_unstale":"2024-09-10T07:47:46.172952+0000","last_undegraded":"2024-09-10T07:47:46.172952+0000","last_fullsized":"2024-09-10T07:47:46.172952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:34.233270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172849+0000","last_change":"2024-09-10T07:47:31.868932+0000","last_active":"2024-09-10T07:47:46.172849+0000","last_peered":"2024-09-10T07:47:46.172849+0000","last_clean":"2024-09-10T07:47:46.172849+0000","last_became_active":"2024-09-10T07:47:31.868534+0000","last_became_peered":"2024-09-10T07:47:31.868534+0000","last_unstale":"2024-09-10T07:47:46.172849+0000","last_undegraded":"2024-09-10T07:47:46.172849+0000","last_fullsized":"2024-09-10T07:47:46.172849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:12.164453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177434+0000","last_change":"2024-09-10T07:47:29.858029+0000","last_active":"2024-09-10T07:47:46.177434+0000","last_peered":"2024-09-10T07:47:46.177434+0000","last_clean":"2024-09-10T07:47:46.177434+0000","last_became_active":"2024-09-10T07:47:29.857556+0000","last_became_peered":"2024-09-10T07:47:29.857556+0000","last_unstale":"2024-09-10T07:47:46.177434+0000","last_undegraded":"2024-09-10T07:47:46.177434+0000","last_fullsized":"2024-09-10T07:47:46.177434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:37.831252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192589+0000","last_change":"2024-09-10T07:47:29.856390+0000","last_active":"2024-09-10T07:47:46.192589+0000","last_peered":"2024-09-10T07:47:46.192589+0000","last_clean":"2024-09-10T07:47:46.192589+0000","last_became_active":"2024-09-10T07:47:29.856042+0000","last_became_peered":"2024-09-10T07:47:29.856042+0000","last_unstale":"2024-09-10T07:47:46.192589+0000","last_undegraded":"2024-09-10T07:47:46.192589+0000","last_fullsized":"2024-09-10T07:47:46.192589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:57.934410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171927+0000","last_change":"2024-09-10T07:47:31.863414+0000","last_active":"2024-09-10T07:47:46.171927+0000","last_peered":"2024-09-10T07:47:46.171927+0000","last_clean":"2024-09-10T07:47:46.171927+0000","last_became_active":"2024-09-10T07:47:31.863116+0000","last_became_peered":"2024-09-10T07:47:31.863116+0000","last_unstale":"2024-09-10T07:47:46.171927+0000","last_undegraded":"2024-09-10T07:47:46.171927+0000","last_fullsized":"2024-09-10T07:47:46.171927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:02.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172688+0000","last_change":"2024-09-10T07:47:29.860106+0000","last_active":"2024-09-10T07:47:46.172688+0000","last_peered":"2024-09-10T07:47:46.172688+0000","last_clean":"2024-09-10T07:47:46.172688+0000","last_became_active":"2024-09-10T07:47:29.859700+0000","last_became_peered":"2024-09-10T07:47:29.859700+0000","last_unstale":"2024-09-10T07:47:46.172688+0000","last_undegraded":"2024-09-10T07:47:46.172688+0000","last_fullsized":"2024-09-10T07:47:46.172688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:07.832889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174363+0000","last_change":"2024-09-10T07:47:31.866263+0000","last_active":"2024-09-10T07:47:46.174363+0000","last_peered":"2024-09-10T07:47:46.174363+0000","last_clean":"2024-09-10T07:47:46.174363+0000","last_became_active":"2024-09-10T07:47:31.865911+0000","last_became_peered":"2024-09-10T07:47:31.865911+0000","last_unstale":"2024-09-10T07:47:46.174363+0000","last_undegraded":"2024-09-10T07:47:46.174363+0000","last_fullsized":"2024-09-10T07:47:46.174363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:53.644360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177424+0000","last_change":"2024-09-10T07:47:29.861490+0000","last_active":"2024-09-10T07:47:46.177424+0000","last_peered":"2024-09-10T07:47:46.177424+0000","last_clean":"2024-09-10T07:47:46.177424+0000","last_became_active":"2024-09-10T07:47:29.861042+0000","last_became_peered":"2024-09-10T07:47:29.861042+0000","last_unstale":"2024-09-10T07:47:46.177424+0000","last_undegraded":"2024-09-10T07:47:46.177424+0000","last_fullsized":"2024-09-10T07:47:46.177424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:12.626954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173037+0000","last_change":"2024-09-10T07:47:31.871792+0000","last_active":"2024-09-10T07:47:46.173037+0000","last_peered":"2024-09-10T07:47:46.173037+0000","last_clean":"2024-09-10T07:47:46.173037+0000","last_became_active":"2024-09-10T07:47:31.870859+0000","last_became_peered":"2024-09-10T07:47:31.870859+0000","last_unstale":"2024-09-10T07:47:46.173037+0000","last_undegraded":"2024-09-10T07:47:46.173037+0000","last_fullsized":"2024-09-10T07:47:46.173037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:08.479377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174617+0000","last_change":"2024-09-10T07:47:29.862475+0000","last_active":"2024-09-10T07:47:46.174617+0000","last_peered":"2024-09-10T07:47:46.174617+0000","last_clean":"2024-09-10T07:47:46.174617+0000","last_became_active":"2024-09-10T07:47:29.862094+0000","last_became_peered":"2024-09-10T07:47:29.862094+0000","last_unstale":"2024-09-10T07:47:46.174617+0000","last_undegraded":"2024-09-10T07:47:46.174617+0000","last_fullsized":"2024-09-10T07:47:46.174617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:25.933844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176742+0000","last_change":"2024-09-10T07:47:31.868963+0000","last_active":"2024-09-10T07:47:46.176742+0000","last_peered":"2024-09-10T07:47:46.176742+0000","last_clean":"2024-09-10T07:47:46.176742+0000","last_became_active":"2024-09-10T07:47:31.868650+0000","last_became_peered":"2024-09-10T07:47:31.868650+0000","last_unstale":"2024-09-10T07:47:46.176742+0000","last_undegraded":"2024-09-10T07:47:46.176742+0000","last_fullsized":"2024-09-10T07:47:46.176742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:39.613235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172874+0000","last_change":"2024-09-10T07:47:29.861572+0000","last_active":"2024-09-10T07:47:46.172874+0000","last_peered":"2024-09-10T07:47:46.172874+0000","last_clean":"2024-09-10T07:47:46.172874+0000","last_became_active":"2024-09-10T07:47:29.860710+0000","last_became_peered":"2024-09-10T07:47:29.860710+0000","last_unstale":"2024-09-10T07:47:46.172874+0000","last_undegraded":"2024-09-10T07:47:46.172874+0000","last_fullsized":"2024-09-10T07:47:46.172874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:28.535090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173093+0000","last_change":"2024-09-10T07:47:31.869976+0000","last_active":"2024-09-10T07:47:46.173093+0000","last_peered":"2024-09-10T07:47:46.173093+0000","last_clean":"2024-09-10T07:47:46.173093+0000","last_became_active":"2024-09-10T07:47:31.868678+0000","last_became_peered":"2024-09-10T07:47:31.868678+0000","last_unstale":"2024-09-10T07:47:46.173093+0000","last_undegraded":"2024-09-10T07:47:46.173093+0000","last_fullsized":"2024-09-10T07:47:46.173093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:38.362180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'25","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:52.554239+0000","last_change":"2024-09-10T07:47:29.863534+0000","last_active":"2024-09-10T07:47:52.554239+0000","last_peered":"2024-09-10T07:47:52.554239+0000","last_clean":"2024-09-10T07:47:52.554239+0000","last_became_active":"2024-09-10T07:47:29.863136+0000","last_became_peered":"2024-09-10T07:47:29.863136+0000","last_unstale":"2024-09-10T07:47:52.554239+0000","last_undegraded":"2024-09-10T07:47:52.554239+0000","last_fullsized":"2024-09-10T07:47:52.554239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:21.261019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":55,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178297+0000","last_change":"2024-09-10T07:47:31.866435+0000","last_active":"2024-09-10T07:47:46.178297+0000","last_peered":"2024-09-10T07:47:46.178297+0000","last_clean":"2024-09-10T07:47:46.178297+0000","last_became_active":"2024-09-10T07:47:31.866099+0000","last_became_peered":"2024-09-10T07:47:31.866099+0000","last_unstale":"2024-09-10T07:47:46.178297+0000","last_undegraded":"2024-09-10T07:47:46.178297+0000","last_fullsized":"2024-09-10T07:47:46.178297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177210+0000","last_change":"2024-09-10T07:47:29.862633+0000","last_active":"2024-09-10T07:47:46.177210+0000","last_peered":"2024-09-10T07:47:46.177210+0000","last_clean":"2024-09-10T07:47:46.177210+0000","last_became_active":"2024-09-10T07:47:29.862214+0000","last_became_peered":"2024-09-10T07:47:29.862214+0000","last_unstale":"2024-09-10T07:47:46.177210+0000","last_undegraded":"2024-09-10T07:47:46.177210+0000","last_fullsized":"2024-09-10T07:47:46.177210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:34.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192682+0000","last_change":"2024-09-10T07:47:31.863361+0000","last_active":"2024-09-10T07:47:46.192682+0000","last_peered":"2024-09-10T07:47:46.192682+0000","last_clean":"2024-09-10T07:47:46.192682+0000","last_became_active":"2024-09-10T07:47:31.863048+0000","last_became_peered":"2024-09-10T07:47:31.863048+0000","last_unstale":"2024-09-10T07:47:46.192682+0000","last_undegraded":"2024-09-10T07:47:46.192682+0000","last_fullsized":"2024-09-10T07:47:46.192682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:54.770006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173311+0000","last_change":"2024-09-10T07:47:29.858767+0000","last_active":"2024-09-10T07:47:46.173311+0000","last_peered":"2024-09-10T07:47:46.173311+0000","last_clean":"2024-09-10T07:47:46.173311+0000","last_became_active":"2024-09-10T07:47:29.858419+0000","last_became_peered":"2024-09-10T07:47:29.858419+0000","last_unstale":"2024-09-10T07:47:46.173311+0000","last_undegraded":"2024-09-10T07:47:46.173311+0000","last_fullsized":"2024-09-10T07:47:46.173311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:03.642873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174068+0000","last_change":"2024-09-10T07:47:31.870593+0000","last_active":"2024-09-10T07:47:46.174068+0000","last_peered":"2024-09-10T07:47:46.174068+0000","last_clean":"2024-09-10T07:47:46.174068+0000","last_became_active":"2024-09-10T07:47:31.870285+0000","last_became_peered":"2024-09-10T07:47:31.870285+0000","last_unstale":"2024-09-10T07:47:46.174068+0000","last_undegraded":"2024-09-10T07:47:46.174068+0000","last_fullsized":"2024-09-10T07:47:46.174068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:49.370065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192726+0000","last_change":"2024-09-10T07:47:29.856937+0000","last_active":"2024-09-10T07:47:46.192726+0000","last_peered":"2024-09-10T07:47:46.192726+0000","last_clean":"2024-09-10T07:47:46.192726+0000","last_became_active":"2024-09-10T07:47:29.856559+0000","last_became_peered":"2024-09-10T07:47:29.856559+0000","last_unstale":"2024-09-10T07:47:46.192726+0000","last_undegraded":"2024-09-10T07:47:46.192726+0000","last_fullsized":"2024-09-10T07:47:46.192726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:01.135693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174684+0000","last_change":"2024-09-10T07:47:31.871743+0000","last_active":"2024-09-10T07:47:46.174684+0000","last_peered":"2024-09-10T07:47:46.174684+0000","last_clean":"2024-09-10T07:47:46.174684+0000","last_became_active":"2024-09-10T07:47:31.871395+0000","last_became_peered":"2024-09-10T07:47:31.871395+0000","last_unstale":"2024-09-10T07:47:46.174684+0000","last_undegraded":"2024-09-10T07:47:46.174684+0000","last_fullsized":"2024-09-10T07:47:46.174684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:18.450216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176747+0000","last_change":"2024-09-10T07:47:29.863405+0000","last_active":"2024-09-10T07:47:46.176747+0000","last_peered":"2024-09-10T07:47:46.176747+0000","last_clean":"2024-09-10T07:47:46.176747+0000","last_became_active":"2024-09-10T07:47:29.862832+0000","last_became_peered":"2024-09-10T07:47:29.862832+0000","last_unstale":"2024-09-10T07:47:46.176747+0000","last_undegraded":"2024-09-10T07:47:46.176747+0000","last_fullsized":"2024-09-10T07:47:46.176747+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:10.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173136+0000","last_change":"2024-09-10T07:47:31.872412+0000","last_active":"2024-09-10T07:47:46.173136+0000","last_peered":"2024-09-10T07:47:46.173136+0000","last_clean":"2024-09-10T07:47:46.173136+0000","last_became_active":"2024-09-10T07:47:31.871380+0000","last_became_peered":"2024-09-10T07:47:31.871380+0000","last_unstale":"2024-09-10T07:47:46.173136+0000","last_undegraded":"2024-09-10T07:47:46.173136+0000","last_fullsized":"2024-09-10T07:47:46.173136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:09.730443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178875+0000","last_change":"2024-09-10T07:47:29.861556+0000","last_active":"2024-09-10T07:47:46.178875+0000","last_peered":"2024-09-10T07:47:46.178875+0000","last_clean":"2024-09-10T07:47:46.178875+0000","last_became_active":"2024-09-10T07:47:29.861053+0000","last_became_peered":"2024-09-10T07:47:29.861053+0000","last_unstale":"2024-09-10T07:47:46.178875+0000","last_undegraded":"2024-09-10T07:47:46.178875+0000","last_fullsized":"2024-09-10T07:47:46.178875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:21.969667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174106+0000","last_change":"2024-09-10T07:47:31.868023+0000","last_active":"2024-09-10T07:47:46.174106+0000","last_peered":"2024-09-10T07:47:46.174106+0000","last_clean":"2024-09-10T07:47:46.174106+0000","last_became_active":"2024-09-10T07:47:31.867722+0000","last_became_peered":"2024-09-10T07:47:31.867722+0000","last_unstale":"2024-09-10T07:47:46.174106+0000","last_undegraded":"2024-09-10T07:47:46.174106+0000","last_fullsized":"2024-09-10T07:47:46.174106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:01.399800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192980+0000","last_change":"2024-09-10T07:47:29.862054+0000","last_active":"2024-09-10T07:47:46.192980+0000","last_peered":"2024-09-10T07:47:46.192980+0000","last_clean":"2024-09-10T07:47:46.192980+0000","last_became_active":"2024-09-10T07:47:29.861731+0000","last_became_peered":"2024-09-10T07:47:29.861731+0000","last_unstale":"2024-09-10T07:47:46.192980+0000","last_undegraded":"2024-09-10T07:47:46.192980+0000","last_fullsized":"2024-09-10T07:47:46.192980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:45.043458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174768+0000","last_change":"2024-09-10T07:47:31.871372+0000","last_active":"2024-09-10T07:47:46.174768+0000","last_peered":"2024-09-10T07:47:46.174768+0000","last_clean":"2024-09-10T07:47:46.174768+0000","last_became_active":"2024-09-10T07:47:31.871048+0000","last_became_peered":"2024-09-10T07:47:31.871048+0000","last_unstale":"2024-09-10T07:47:46.174768+0000","last_undegraded":"2024-09-10T07:47:46.174768+0000","last_fullsized":"2024-09-10T07:47:46.174768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:58.934809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172999+0000","last_change":"2024-09-10T07:47:29.861974+0000","last_active":"2024-09-10T07:47:46.172999+0000","last_peered":"2024-09-10T07:47:46.172999+0000","last_clean":"2024-09-10T07:47:46.172999+0000","last_became_active":"2024-09-10T07:47:29.861240+0000","last_became_peered":"2024-09-10T07:47:29.861240+0000","last_unstale":"2024-09-10T07:47:46.172999+0000","last_undegraded":"2024-09-10T07:47:46.172999+0000","last_fullsized":"2024-09-10T07:47:46.172999+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:05.235927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174244+0000","last_change":"2024-09-10T07:47:31.871807+0000","last_active":"2024-09-10T07:47:46.174244+0000","last_peered":"2024-09-10T07:47:46.174244+0000","last_clean":"2024-09-10T07:47:46.174244+0000","last_became_active":"2024-09-10T07:47:31.871489+0000","last_became_peered":"2024-09-10T07:47:31.871489+0000","last_unstale":"2024-09-10T07:47:46.174244+0000","last_undegraded":"2024-09-10T07:47:46.174244+0000","last_fullsized":"2024-09-10T07:47:46.174244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:00.754188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176930+0000","last_change":"2024-09-10T07:47:30.089332+0000","last_active":"2024-09-10T07:47:46.176930+0000","last_peered":"2024-09-10T07:47:46.176930+0000","last_clean":"2024-09-10T07:47:46.176930+0000","last_became_active":"2024-09-10T07:47:30.088879+0000","last_became_peered":"2024-09-10T07:47:30.088879+0000","last_unstale":"2024-09-10T07:47:46.176930+0000","last_undegraded":"2024-09-10T07:47:46.176930+0000","last_fullsized":"2024-09-10T07:47:46.176930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:40.875957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174405+0000","last_change":"2024-09-10T07:47:31.873732+0000","last_active":"2024-09-10T07:47:46.174405+0000","last_peered":"2024-09-10T07:47:46.174405+0000","last_clean":"2024-09-10T07:47:46.174405+0000","last_became_active":"2024-09-10T07:47:31.873291+0000","last_became_peered":"2024-09-10T07:47:31.873291+0000","last_unstale":"2024-09-10T07:47:46.174405+0000","last_undegraded":"2024-09-10T07:47:46.174405+0000","last_fullsized":"2024-09-10T07:47:46.174405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:02.095237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174815+0000","last_change":"2024-09-10T07:46:21.922704+0000","last_active":"2024-09-10T07:47:46.174815+0000","last_peered":"2024-09-10T07:47:46.174815+0000","last_clean":"2024-09-10T07:47:46.174815+0000","last_became_active":"2024-09-10T07:46:21.922144+0000","last_became_peered":"2024-09-10T07:46:21.922144+0000","last_unstale":"2024-09-10T07:47:46.174815+0000","last_undegraded":"2024-09-10T07:47:46.174815+0000","last_fullsized":"2024-09-10T07:47:46.174815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:42:58.927087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:42:58.927087+0000","last_clean_scrub_stamp":"2024-09-10T07:42:58.927087+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:11.355989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192853+0000","last_change":"2024-09-10T07:47:29.859739+0000","last_active":"2024-09-10T07:47:46.192853+0000","last_peered":"2024-09-10T07:47:46.192853+0000","last_clean":"2024-09-10T07:47:46.192853+0000","last_became_active":"2024-09-10T07:47:29.859223+0000","last_became_peered":"2024-09-10T07:47:29.859223+0000","last_unstale":"2024-09-10T07:47:46.192853+0000","last_undegraded":"2024-09-10T07:47:46.192853+0000","last_fullsized":"2024-09-10T07:47:46.192853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:48.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176834+0000","last_change":"2024-09-10T07:47:46.176368+0000","last_active":"2024-09-10T07:47:46.176834+0000","last_peered":"2024-09-10T07:47:46.176834+0000","last_clean":"2024-09-10T07:47:46.176834+0000","last_became_active":"2024-09-10T07:47:46.176008+0000","last_became_peered":"2024-09-10T07:47:46.176008+0000","last_unstale":"2024-09-10T07:47:46.176834+0000","last_undegraded":"2024-09-10T07:47:46.176834+0000","last_fullsized":"2024-09-10T07:47:46.176834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:45.707644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174793+0000","last_change":"2024-09-10T07:47:29.861314+0000","last_active":"2024-09-10T07:47:46.174793+0000","last_peered":"2024-09-10T07:47:46.174793+0000","last_clean":"2024-09-10T07:47:46.174793+0000","last_became_active":"2024-09-10T07:47:29.860946+0000","last_became_peered":"2024-09-10T07:47:29.860946+0000","last_unstale":"2024-09-10T07:47:46.174793+0000","last_undegraded":"2024-09-10T07:47:46.174793+0000","last_fullsized":"2024-09-10T07:47:46.174793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:38.530660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192570+0000","last_change":"2024-09-10T07:47:31.867374+0000","last_active":"2024-09-10T07:47:46.192570+0000","last_peered":"2024-09-10T07:47:46.192570+0000","last_clean":"2024-09-10T07:47:46.192570+0000","last_became_active":"2024-09-10T07:47:31.867065+0000","last_became_peered":"2024-09-10T07:47:31.867065+0000","last_unstale":"2024-09-10T07:47:46.192570+0000","last_undegraded":"2024-09-10T07:47:46.192570+0000","last_fullsized":"2024-09-10T07:47:46.192570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:07.688314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192682+0000","last_change":"2024-09-10T07:47:29.854853+0000","last_active":"2024-09-10T07:47:46.192682+0000","last_peered":"2024-09-10T07:47:46.192682+0000","last_clean":"2024-09-10T07:47:46.192682+0000","last_became_active":"2024-09-10T07:47:29.854553+0000","last_became_peered":"2024-09-10T07:47:29.854553+0000","last_unstale":"2024-09-10T07:47:46.192682+0000","last_undegraded":"2024-09-10T07:47:46.192682+0000","last_fullsized":"2024-09-10T07:47:46.192682+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:34.570076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172538+0000","last_change":"2024-09-10T07:47:31.868522+0000","last_active":"2024-09-10T07:47:46.172538+0000","last_peered":"2024-09-10T07:47:46.172538+0000","last_clean":"2024-09-10T07:47:46.172538+0000","last_became_active":"2024-09-10T07:47:31.868114+0000","last_became_peered":"2024-09-10T07:47:31.868114+0000","last_unstale":"2024-09-10T07:47:46.172538+0000","last_undegraded":"2024-09-10T07:47:46.172538+0000","last_fullsized":"2024-09-10T07:47:46.172538+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.442513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174097+0000","last_change":"2024-09-10T07:47:29.856185+0000","last_active":"2024-09-10T07:47:46.174097+0000","last_peered":"2024-09-10T07:47:46.174097+0000","last_clean":"2024-09-10T07:47:46.174097+0000","last_became_active":"2024-09-10T07:47:29.855809+0000","last_became_peered":"2024-09-10T07:47:29.855809+0000","last_unstale":"2024-09-10T07:47:46.174097+0000","last_undegraded":"2024-09-10T07:47:46.174097+0000","last_fullsized":"2024-09-10T07:47:46.174097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:55.325391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177351+0000","last_change":"2024-09-10T07:47:31.862955+0000","last_active":"2024-09-10T07:47:46.177351+0000","last_peered":"2024-09-10T07:47:46.177351+0000","last_clean":"2024-09-10T07:47:46.177351+0000","last_became_active":"2024-09-10T07:47:31.862671+0000","last_became_peered":"2024-09-10T07:47:31.862671+0000","last_unstale":"2024-09-10T07:47:46.177351+0000","last_undegraded":"2024-09-10T07:47:46.177351+0000","last_fullsized":"2024-09-10T07:47:46.177351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:54.858623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174440+0000","last_change":"2024-09-10T07:47:29.861345+0000","last_active":"2024-09-10T07:47:46.174440+0000","last_peered":"2024-09-10T07:47:46.174440+0000","last_clean":"2024-09-10T07:47:46.174440+0000","last_became_active":"2024-09-10T07:47:29.860987+0000","last_became_peered":"2024-09-10T07:47:29.860987+0000","last_unstale":"2024-09-10T07:47:46.174440+0000","last_undegraded":"2024-09-10T07:47:46.174440+0000","last_fullsized":"2024-09-10T07:47:46.174440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:33.202676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176992+0000","last_change":"2024-09-10T07:47:31.861217+0000","last_active":"2024-09-10T07:47:46.176992+0000","last_peered":"2024-09-10T07:47:46.176992+0000","last_clean":"2024-09-10T07:47:46.176992+0000","last_became_active":"2024-09-10T07:47:31.860572+0000","last_became_peered":"2024-09-10T07:47:31.860572+0000","last_unstale":"2024-09-10T07:47:46.176992+0000","last_undegraded":"2024-09-10T07:47:46.176992+0000","last_fullsized":"2024-09-10T07:47:46.176992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:39.537642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.179624+0000","last_change":"2024-09-10T07:47:29.855256+0000","last_active":"2024-09-10T07:47:46.179624+0000","last_peered":"2024-09-10T07:47:46.179624+0000","last_clean":"2024-09-10T07:47:46.179624+0000","last_became_active":"2024-09-10T07:47:29.854922+0000","last_became_peered":"2024-09-10T07:47:29.854922+0000","last_unstale":"2024-09-10T07:47:46.179624+0000","last_undegraded":"2024-09-10T07:47:46.179624+0000","last_fullsized":"2024-09-10T07:47:46.179624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:44.264077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192868+0000","last_change":"2024-09-10T07:47:31.866057+0000","last_active":"2024-09-10T07:47:46.192868+0000","last_peered":"2024-09-10T07:47:46.192868+0000","last_clean":"2024-09-10T07:47:46.192868+0000","last_became_active":"2024-09-10T07:47:31.865696+0000","last_became_peered":"2024-09-10T07:47:31.865696+0000","last_unstale":"2024-09-10T07:47:46.192868+0000","last_undegraded":"2024-09-10T07:47:46.192868+0000","last_fullsized":"2024-09-10T07:47:46.192868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:31.904881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:51.127458+0000","last_change":"2024-09-10T07:47:29.853800+0000","last_active":"2024-09-10T07:47:51.127458+0000","last_peered":"2024-09-10T07:47:51.127458+0000","last_clean":"2024-09-10T07:47:51.127458+0000","last_became_active":"2024-09-10T07:47:29.853480+0000","last_became_peered":"2024-09-10T07:47:29.853480+0000","last_unstale":"2024-09-10T07:47:51.127458+0000","last_undegraded":"2024-09-10T07:47:51.127458+0000","last_fullsized":"2024-09-10T07:47:51.127458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:31.683236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173078+0000","last_change":"2024-09-10T07:47:31.864686+0000","last_active":"2024-09-10T07:47:46.173078+0000","last_peered":"2024-09-10T07:47:46.173078+0000","last_clean":"2024-09-10T07:47:46.173078+0000","last_became_active":"2024-09-10T07:47:31.864188+0000","last_became_peered":"2024-09-10T07:47:31.864188+0000","last_unstale":"2024-09-10T07:47:46.173078+0000","last_undegraded":"2024-09-10T07:47:46.173078+0000","last_fullsized":"2024-09-10T07:47:46.173078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:15.838121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.193128+0000","last_change":"2024-09-10T07:47:30.089172+0000","last_active":"2024-09-10T07:47:46.193128+0000","last_peered":"2024-09-10T07:47:46.193128+0000","last_clean":"2024-09-10T07:47:46.193128+0000","last_became_active":"2024-09-10T07:47:30.088859+0000","last_became_peered":"2024-09-10T07:47:30.088859+0000","last_unstale":"2024-09-10T07:47:46.193128+0000","last_undegraded":"2024-09-10T07:47:46.193128+0000","last_fullsized":"2024-09-10T07:47:46.193128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:22.415581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176427+0000","last_change":"2024-09-10T07:47:31.863676+0000","last_active":"2024-09-10T07:47:46.176427+0000","last_peered":"2024-09-10T07:47:46.176427+0000","last_clean":"2024-09-10T07:47:46.176427+0000","last_became_active":"2024-09-10T07:47:31.863399+0000","last_became_peered":"2024-09-10T07:47:31.863399+0000","last_unstale":"2024-09-10T07:47:46.176427+0000","last_undegraded":"2024-09-10T07:47:46.176427+0000","last_fullsized":"2024-09-10T07:47:46.176427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:40.168078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172713+0000","last_change":"2024-09-10T07:47:29.862578+0000","last_active":"2024-09-10T07:47:46.172713+0000","last_peered":"2024-09-10T07:47:46.172713+0000","last_clean":"2024-09-10T07:47:46.172713+0000","last_became_active":"2024-09-10T07:47:29.862157+0000","last_became_peered":"2024-09-10T07:47:29.862157+0000","last_unstale":"2024-09-10T07:47:46.172713+0000","last_undegraded":"2024-09-10T07:47:46.172713+0000","last_fullsized":"2024-09-10T07:47:46.172713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:47.201556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176894+0000","last_change":"2024-09-10T07:47:31.865766+0000","last_active":"2024-09-10T07:47:46.176894+0000","last_peered":"2024-09-10T07:47:46.176894+0000","last_clean":"2024-09-10T07:47:46.176894+0000","last_became_active":"2024-09-10T07:47:31.865416+0000","last_became_peered":"2024-09-10T07:47:31.865416+0000","last_unstale":"2024-09-10T07:47:46.176894+0000","last_undegraded":"2024-09-10T07:47:46.176894+0000","last_fullsized":"2024-09-10T07:47:46.176894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.274836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171982+0000","last_change":"2024-09-10T07:47:29.856768+0000","last_active":"2024-09-10T07:47:46.171982+0000","last_peered":"2024-09-10T07:47:46.171982+0000","last_clean":"2024-09-10T07:47:46.171982+0000","last_became_active":"2024-09-10T07:47:29.856457+0000","last_became_peered":"2024-09-10T07:47:29.856457+0000","last_unstale":"2024-09-10T07:47:46.171982+0000","last_undegraded":"2024-09-10T07:47:46.171982+0000","last_fullsized":"2024-09-10T07:47:46.171982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:17.227156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173830+0000","last_change":"2024-09-10T07:47:31.865457+0000","last_active":"2024-09-10T07:47:46.173830+0000","last_peered":"2024-09-10T07:47:46.173830+0000","last_clean":"2024-09-10T07:47:46.173830+0000","last_became_active":"2024-09-10T07:47:31.864801+0000","last_became_peered":"2024-09-10T07:47:31.864801+0000","last_unstale":"2024-09-10T07:47:46.173830+0000","last_undegraded":"2024-09-10T07:47:46.173830+0000","last_fullsized":"2024-09-10T07:47:46.173830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:59.236321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.182025+0000","last_change":"2024-09-10T07:47:46.180534+0000","last_active":"2024-09-10T07:47:46.182025+0000","last_peered":"2024-09-10T07:47:46.182025+0000","last_clean":"2024-09-10T07:47:46.182025+0000","last_became_active":"2024-09-10T07:47:46.180067+0000","last_became_peered":"2024-09-10T07:47:46.180067+0000","last_unstale":"2024-09-10T07:47:46.182025+0000","last_undegraded":"2024-09-10T07:47:46.182025+0000","last_fullsized":"2024-09-10T07:47:46.182025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:39.221934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172418+0000","last_change":"2024-09-10T07:47:31.864617+0000","last_active":"2024-09-10T07:47:46.172418+0000","last_peered":"2024-09-10T07:47:46.172418+0000","last_clean":"2024-09-10T07:47:46.172418+0000","last_became_active":"2024-09-10T07:47:31.864284+0000","last_became_peered":"2024-09-10T07:47:31.864284+0000","last_unstale":"2024-09-10T07:47:46.172418+0000","last_undegraded":"2024-09-10T07:47:46.172418+0000","last_fullsized":"2024-09-10T07:47:46.172418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:31.406445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.185054+0000","last_change":"2024-09-10T07:47:46.184591+0000","last_active":"2024-09-10T07:47:46.185054+0000","last_peered":"2024-09-10T07:47:46.185054+0000","last_clean":"2024-09-10T07:47:46.185054+0000","last_became_active":"2024-09-10T07:47:46.179474+0000","last_became_peered":"2024-09-10T07:47:46.179474+0000","last_unstale":"2024-09-10T07:47:46.185054+0000","last_undegraded":"2024-09-10T07:47:46.185054+0000","last_fullsized":"2024-09-10T07:47:46.185054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:02.752937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173972+0000","last_change":"2024-09-10T07:47:31.869921+0000","last_active":"2024-09-10T07:47:46.173972+0000","last_peered":"2024-09-10T07:47:46.173972+0000","last_clean":"2024-09-10T07:47:46.173972+0000","last_became_active":"2024-09-10T07:47:31.869602+0000","last_became_peered":"2024-09-10T07:47:31.869602+0000","last_unstale":"2024-09-10T07:47:46.173972+0000","last_undegraded":"2024-09-10T07:47:46.173972+0000","last_fullsized":"2024-09-10T07:47:46.173972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:50.590335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.181800+0000","last_change":"2024-09-10T07:47:46.181800+0000","last_active":"2024-09-10T07:47:46.181800+0000","last_peered":"2024-09-10T07:47:46.181800+0000","last_clean":"2024-09-10T07:47:46.181800+0000","last_became_active":"2024-09-10T07:47:46.181358+0000","last_became_peered":"2024-09-10T07:47:46.181358+0000","last_unstale":"2024-09-10T07:47:46.181800+0000","last_undegraded":"2024-09-10T07:47:46.181800+0000","last_fullsized":"2024-09-10T07:47:46.181800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:23.311525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178303+0000","last_change":"2024-09-10T07:47:29.862301+0000","last_active":"2024-09-10T07:47:46.178303+0000","last_peered":"2024-09-10T07:47:46.178303+0000","last_clean":"2024-09-10T07:47:46.178303+0000","last_became_active":"2024-09-10T07:47:29.861113+0000","last_became_peered":"2024-09-10T07:47:29.861113+0000","last_unstale":"2024-09-10T07:47:46.178303+0000","last_undegraded":"2024-09-10T07:47:46.178303+0000","last_fullsized":"2024-09-10T07:47:46.178303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:14.923430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172699+0000","last_change":"2024-09-10T07:47:31.871097+0000","last_active":"2024-09-10T07:47:46.172699+0000","last_peered":"2024-09-10T07:47:46.172699+0000","last_clean":"2024-09-10T07:47:46.172699+0000","last_became_active":"2024-09-10T07:47:31.869399+0000","last_became_peered":"2024-09-10T07:47:31.869399+0000","last_unstale":"2024-09-10T07:47:46.172699+0000","last_undegraded":"2024-09-10T07:47:46.172699+0000","last_fullsized":"2024-09-10T07:47:46.172699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:07.967838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.186555+0000","last_change":"2024-09-10T07:47:46.186555+0000","last_active":"2024-09-10T07:47:46.186555+0000","last_peered":"2024-09-10T07:47:46.186555+0000","last_clean":"2024-09-10T07:47:46.186555+0000","last_became_active":"2024-09-10T07:47:46.182966+0000","last_became_peered":"2024-09-10T07:47:46.182966+0000","last_unstale":"2024-09-10T07:47:46.186555+0000","last_undegraded":"2024-09-10T07:47:46.186555+0000","last_fullsized":"2024-09-10T07:47:46.186555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:32.435739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176715+0000","last_change":"2024-09-10T07:47:31.873450+0000","last_active":"2024-09-10T07:47:46.176715+0000","last_peered":"2024-09-10T07:47:46.176715+0000","last_clean":"2024-09-10T07:47:46.176715+0000","last_became_active":"2024-09-10T07:47:31.873134+0000","last_became_peered":"2024-09-10T07:47:31.873134+0000","last_unstale":"2024-09-10T07:47:46.176715+0000","last_undegraded":"2024-09-10T07:47:46.176715+0000","last_fullsized":"2024-09-10T07:47:46.176715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:19.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173185+0000","last_change":"2024-09-10T07:47:29.861395+0000","last_active":"2024-09-10T07:47:46.173185+0000","last_peered":"2024-09-10T07:47:46.173185+0000","last_clean":"2024-09-10T07:47:46.173185+0000","last_became_active":"2024-09-10T07:47:29.861002+0000","last_became_peered":"2024-09-10T07:47:29.861002+0000","last_unstale":"2024-09-10T07:47:46.173185+0000","last_undegraded":"2024-09-10T07:47:46.173185+0000","last_fullsized":"2024-09-10T07:47:46.173185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:59.347663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172934+0000","last_change":"2024-09-10T07:47:31.872400+0000","last_active":"2024-09-10T07:47:46.172934+0000","last_peered":"2024-09-10T07:47:46.172934+0000","last_clean":"2024-09-10T07:47:46.172934+0000","last_became_active":"2024-09-10T07:47:31.871995+0000","last_became_peered":"2024-09-10T07:47:31.871995+0000","last_unstale":"2024-09-10T07:47:46.172934+0000","last_undegraded":"2024-09-10T07:47:46.172934+0000","last_fullsized":"2024-09-10T07:47:46.172934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:51.421387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.198560+0000","last_change":"2024-09-10T07:47:46.198560+0000","last_active":"2024-09-10T07:47:46.198560+0000","last_peered":"2024-09-10T07:47:46.198560+0000","last_clean":"2024-09-10T07:47:46.198560+0000","last_became_active":"2024-09-10T07:47:46.194070+0000","last_became_peered":"2024-09-10T07:47:46.194070+0000","last_unstale":"2024-09-10T07:47:46.198560+0000","last_undegraded":"2024-09-10T07:47:46.198560+0000","last_fullsized":"2024-09-10T07:47:46.198560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:03.590728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":35,"num_read_kb":58,"num_write":77,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":149793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":441646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1564672,"data_stored":1073390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972379,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":442228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234016,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":441668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1032713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":441763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1032313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":442250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":441984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":494847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":482711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":441736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T07:47:55.418 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T07:47:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:56.053 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:55 smithi073 ceph-mon[30850]: pgmap v288: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.7 KiB/s wr, 5 op/s; 61 B/s, 0 objects/s recovering 2024-09-10T07:47:56.053 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:55 smithi073 ceph-mon[30850]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:47:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:55 smithi102 ceph-mon[35514]: pgmap v288: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.7 KiB/s wr, 5 op/s; 61 B/s, 0 objects/s recovering 2024-09-10T07:47:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:55 smithi102 ceph-mon[35514]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:47:56.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.132+0000 7f657ab38640 1 -- 172.21.15.73:0/3883342792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574100e20 msgr2=0x7f6574101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:56.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.132+0000 7f657ab38640 1 --2- 172.21.15.73:0/3883342792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574100e20 0x7f6574101200 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6570009900 tx=0x7f657002a480 comp rx=0 tx=0).stop 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.132+0000 7f657ab38640 1 -- 172.21.15.73:0/3883342792 shutdown_connections 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.132+0000 7f657ab38640 1 --2- 172.21.15.73:0/3883342792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6574102ef0 0x7f657410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.132+0000 7f657ab38640 1 --2- 172.21.15.73:0/3883342792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6574102570 0x7f65741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.132+0000 7f657ab38640 1 --2- 172.21.15.73:0/3883342792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574100e20 0x7f6574101200 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.132+0000 7f657ab38640 1 -- 172.21.15.73:0/3883342792 >> 172.21.15.73:0/3883342792 conn(0x7f65740fc7d0 msgr2=0x7f65740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.132+0000 7f657ab38640 1 -- 172.21.15.73:0/3883342792 shutdown_connections 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.132+0000 7f657ab38640 1 -- 172.21.15.73:0/3883342792 wait complete. 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f657ab38640 1 Processor -- start 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f657ab38640 1 -- start start 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f657ab38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6574100e20 0x7f6574197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f657ab38640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574102570 0x7f6574197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f657ab38640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6574102ef0 0x7f657419bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f657ab38640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6574110f50 con 0x7f6574102570 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f657ab38640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6574110dd0 con 0x7f6574100e20 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f657ab38640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f65741110d0 con 0x7f6574102ef0 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f656bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574102570 0x7f6574197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f656bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574102570 0x7f6574197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53114/0 (socket says 172.21.15.73:53114) 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f656bfff640 1 -- 172.21.15.73:0/544779346 learned_addr learned my addr 172.21.15.73:0/544779346 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f65788d4640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6574100e20 0x7f6574197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.133+0000 7f65790d5640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6574102ef0 0x7f657419bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f656bfff640 1 -- 172.21.15.73:0/544779346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6574102ef0 msgr2=0x7f657419bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f656bfff640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6574102ef0 0x7f657419bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f656bfff640 1 -- 172.21.15.73:0/544779346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6574100e20 msgr2=0x7f6574197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f656bfff640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6574100e20 0x7f6574197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f656bfff640 1 -- 172.21.15.73:0/544779346 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657419c3c0 con 0x7f6574102570 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f65788d4640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6574100e20 0x7f6574197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f656bfff640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574102570 0x7f6574197950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f656400c920 tx=0x7f656400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f6569ffb640 1 -- 172.21.15.73:0/544779346 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564007c70 con 0x7f6574102570 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657419c6b0 con 0x7f6574102570 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f6569ffb640 1 -- 172.21.15.73:0/544779346 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6564007e10 con 0x7f6574102570 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f6569ffb640 1 -- 172.21.15.73:0/544779346 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564018890 con 0x7f6574102570 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.134+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65741a3f90 con 0x7f6574102570 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.135+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6574101200 con 0x7f6574102570 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.136+0000 7f6569ffb640 1 -- 172.21.15.73:0/544779346 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6564018a70 con 0x7f6574102570 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.137+0000 7f6569ffb640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f655c0a2c10 0x7f655c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.137+0000 7f65788d4640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f655c0a2c10 0x7f655c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.137+0000 7f6569ffb640 1 -- 172.21.15.73:0/544779346 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f65640cf3f0 con 0x7f6574102570 2024-09-10T07:47:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.137+0000 7f65788d4640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f655c0a2c10 0x7f655c0a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6570005ab0 tx=0x7f6570005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:56.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.141+0000 7f6569ffb640 1 -- 172.21.15.73:0/544779346 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6564014030 con 0x7f6574102570 2024-09-10T07:47:56.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:55 smithi159 ceph-mon[35522]: pgmap v288: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.7 KiB/s wr, 5 op/s; 61 B/s, 0 objects/s recovering 2024-09-10T07:47:56.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:55 smithi159 ceph-mon[35522]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:47:56.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.305+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6574062630 con 0x7f655c0a2c10 2024-09-10T07:47:56.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.311+0000 7f6569ffb640 1 -- 172.21.15.73:0/544779346 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258644 (secure 0 0 0) 0x7f6574062630 con 0x7f655c0a2c10 2024-09-10T07:47:56.313 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:56.314 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-10T07:47:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f655c0a2c10 msgr2=0x7f655c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f655c0a2c10 0x7f655c0a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6570005ab0 tx=0x7f6570005a20 comp rx=0 tx=0).stop 2024-09-10T07:47:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574102570 msgr2=0x7f6574197950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574102570 0x7f6574197950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f656400c920 tx=0x7f656400cde0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 shutdown_connections 2024-09-10T07:47:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f655c0a2c10 0x7f655c0a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6574102ef0 0x7f657419bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574102570 0x7f6574197950 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 --2- 172.21.15.73:0/544779346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6574100e20 0x7f6574197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 >> 172.21.15.73:0/544779346 conn(0x7f65740fc7d0 msgr2=0x7f6574105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 shutdown_connections 2024-09-10T07:47:56.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:56.314+0000 7f657ab38640 1 -- 172.21.15.73:0/544779346 wait complete. 2024-09-10T07:47:57.051 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-10T07:47:54.664506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":171,"num_read_kb":177,"num_write":260,"num_write_kb":3016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353548,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588276,"statfs":{"total":1151940427776,"available":1151578394624,"internally_reserved":0,"allocated":12890112,"data_stored":7209249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51789,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":47,"num_write":34,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.494628"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174321+0000","last_change":"2024-09-10T07:47:31.876663+0000","last_active":"2024-09-10T07:47:46.174321+0000","last_peered":"2024-09-10T07:47:46.174321+0000","last_clean":"2024-09-10T07:47:46.174321+0000","last_became_active":"2024-09-10T07:47:31.876368+0000","last_became_peered":"2024-09-10T07:47:31.876368+0000","last_unstale":"2024-09-10T07:47:46.174321+0000","last_undegraded":"2024-09-10T07:47:46.174321+0000","last_fullsized":"2024-09-10T07:47:46.174321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:30.203753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176341+0000","last_change":"2024-09-10T07:47:31.867862+0000","last_active":"2024-09-10T07:47:46.176341+0000","last_peered":"2024-09-10T07:47:46.176341+0000","last_clean":"2024-09-10T07:47:46.176341+0000","last_became_active":"2024-09-10T07:47:31.867553+0000","last_became_peered":"2024-09-10T07:47:31.867553+0000","last_unstale":"2024-09-10T07:47:46.176341+0000","last_undegraded":"2024-09-10T07:47:46.176341+0000","last_fullsized":"2024-09-10T07:47:46.176341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:02.809443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176241+0000","last_change":"2024-09-10T07:47:31.873697+0000","last_active":"2024-09-10T07:47:46.176241+0000","last_peered":"2024-09-10T07:47:46.176241+0000","last_clean":"2024-09-10T07:47:46.176241+0000","last_became_active":"2024-09-10T07:47:31.873156+0000","last_became_peered":"2024-09-10T07:47:31.873156+0000","last_unstale":"2024-09-10T07:47:46.176241+0000","last_undegraded":"2024-09-10T07:47:46.176241+0000","last_fullsized":"2024-09-10T07:47:46.176241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:16.365317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192901+0000","last_change":"2024-09-10T07:47:31.869749+0000","last_active":"2024-09-10T07:47:46.192901+0000","last_peered":"2024-09-10T07:47:46.192901+0000","last_clean":"2024-09-10T07:47:46.192901+0000","last_became_active":"2024-09-10T07:47:31.868474+0000","last_became_peered":"2024-09-10T07:47:31.868474+0000","last_unstale":"2024-09-10T07:47:46.192901+0000","last_undegraded":"2024-09-10T07:47:46.192901+0000","last_fullsized":"2024-09-10T07:47:46.192901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:49.809017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177905+0000","last_change":"2024-09-10T07:47:31.864160+0000","last_active":"2024-09-10T07:47:46.177905+0000","last_peered":"2024-09-10T07:47:46.177905+0000","last_clean":"2024-09-10T07:47:46.177905+0000","last_became_active":"2024-09-10T07:47:31.862214+0000","last_became_peered":"2024-09-10T07:47:31.862214+0000","last_unstale":"2024-09-10T07:47:46.177905+0000","last_undegraded":"2024-09-10T07:47:46.177905+0000","last_fullsized":"2024-09-10T07:47:46.177905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:50.422218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.194241+0000","last_change":"2024-09-10T07:47:46.194241+0000","last_active":"2024-09-10T07:47:46.194241+0000","last_peered":"2024-09-10T07:47:46.194241+0000","last_clean":"2024-09-10T07:47:46.194241+0000","last_became_active":"2024-09-10T07:47:46.193667+0000","last_became_peered":"2024-09-10T07:47:46.193667+0000","last_unstale":"2024-09-10T07:47:46.194241+0000","last_undegraded":"2024-09-10T07:47:46.194241+0000","last_fullsized":"2024-09-10T07:47:46.194241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:05.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.193934+0000","last_change":"2024-09-10T07:47:46.193934+0000","last_active":"2024-09-10T07:47:46.193934+0000","last_peered":"2024-09-10T07:47:46.193934+0000","last_clean":"2024-09-10T07:47:46.193934+0000","last_became_active":"2024-09-10T07:47:46.193474+0000","last_became_peered":"2024-09-10T07:47:46.193474+0000","last_unstale":"2024-09-10T07:47:46.193934+0000","last_undegraded":"2024-09-10T07:47:46.193934+0000","last_fullsized":"2024-09-10T07:47:46.193934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:00.465345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171799+0000","last_change":"2024-09-10T07:47:31.871924+0000","last_active":"2024-09-10T07:47:46.171799+0000","last_peered":"2024-09-10T07:47:46.171799+0000","last_clean":"2024-09-10T07:47:46.171799+0000","last_became_active":"2024-09-10T07:47:31.871639+0000","last_became_peered":"2024-09-10T07:47:31.871639+0000","last_unstale":"2024-09-10T07:47:46.171799+0000","last_undegraded":"2024-09-10T07:47:46.171799+0000","last_fullsized":"2024-09-10T07:47:46.171799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:48.248506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173438+0000","last_change":"2024-09-10T07:47:31.876528+0000","last_active":"2024-09-10T07:47:46.173438+0000","last_peered":"2024-09-10T07:47:46.173438+0000","last_clean":"2024-09-10T07:47:46.173438+0000","last_became_active":"2024-09-10T07:47:31.876022+0000","last_became_peered":"2024-09-10T07:47:31.876022+0000","last_unstale":"2024-09-10T07:47:46.173438+0000","last_undegraded":"2024-09-10T07:47:46.173438+0000","last_fullsized":"2024-09-10T07:47:46.173438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:07.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177291+0000","last_change":"2024-09-10T07:47:31.864740+0000","last_active":"2024-09-10T07:47:46.177291+0000","last_peered":"2024-09-10T07:47:46.177291+0000","last_clean":"2024-09-10T07:47:46.177291+0000","last_became_active":"2024-09-10T07:47:31.864138+0000","last_became_peered":"2024-09-10T07:47:31.864138+0000","last_unstale":"2024-09-10T07:47:46.177291+0000","last_undegraded":"2024-09-10T07:47:46.177291+0000","last_fullsized":"2024-09-10T07:47:46.177291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:27.248169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174342+0000","last_change":"2024-09-10T07:47:31.875751+0000","last_active":"2024-09-10T07:47:46.174342+0000","last_peered":"2024-09-10T07:47:46.174342+0000","last_clean":"2024-09-10T07:47:46.174342+0000","last_became_active":"2024-09-10T07:47:31.875399+0000","last_became_peered":"2024-09-10T07:47:31.875399+0000","last_unstale":"2024-09-10T07:47:46.174342+0000","last_undegraded":"2024-09-10T07:47:46.174342+0000","last_fullsized":"2024-09-10T07:47:46.174342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:19.439947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192991+0000","last_change":"2024-09-10T07:47:31.870220+0000","last_active":"2024-09-10T07:47:46.192991+0000","last_peered":"2024-09-10T07:47:46.192991+0000","last_clean":"2024-09-10T07:47:46.192991+0000","last_became_active":"2024-09-10T07:47:31.869018+0000","last_became_peered":"2024-09-10T07:47:31.869018+0000","last_unstale":"2024-09-10T07:47:46.192991+0000","last_undegraded":"2024-09-10T07:47:46.192991+0000","last_fullsized":"2024-09-10T07:47:46.192991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:52.108972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192766+0000","last_change":"2024-09-10T07:47:31.868419+0000","last_active":"2024-09-10T07:47:46.192766+0000","last_peered":"2024-09-10T07:47:46.192766+0000","last_clean":"2024-09-10T07:47:46.192766+0000","last_became_active":"2024-09-10T07:47:31.868093+0000","last_became_peered":"2024-09-10T07:47:31.868093+0000","last_unstale":"2024-09-10T07:47:46.192766+0000","last_undegraded":"2024-09-10T07:47:46.192766+0000","last_fullsized":"2024-09-10T07:47:46.192766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:24.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176134+0000","last_change":"2024-09-10T07:47:31.866974+0000","last_active":"2024-09-10T07:47:46.176134+0000","last_peered":"2024-09-10T07:47:46.176134+0000","last_clean":"2024-09-10T07:47:46.176134+0000","last_became_active":"2024-09-10T07:47:31.866579+0000","last_became_peered":"2024-09-10T07:47:31.866579+0000","last_unstale":"2024-09-10T07:47:46.176134+0000","last_undegraded":"2024-09-10T07:47:46.176134+0000","last_fullsized":"2024-09-10T07:47:46.176134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:47.140259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.180225+0000","last_change":"2024-09-10T07:47:46.180225+0000","last_active":"2024-09-10T07:47:46.180225+0000","last_peered":"2024-09-10T07:47:46.180225+0000","last_clean":"2024-09-10T07:47:46.180225+0000","last_became_active":"2024-09-10T07:47:46.179885+0000","last_became_peered":"2024-09-10T07:47:46.179885+0000","last_unstale":"2024-09-10T07:47:46.180225+0000","last_undegraded":"2024-09-10T07:47:46.180225+0000","last_fullsized":"2024-09-10T07:47:46.180225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:00.796740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172587+0000","last_change":"2024-09-10T07:47:31.876926+0000","last_active":"2024-09-10T07:47:46.172587+0000","last_peered":"2024-09-10T07:47:46.172587+0000","last_clean":"2024-09-10T07:47:46.172587+0000","last_became_active":"2024-09-10T07:47:31.876620+0000","last_became_peered":"2024-09-10T07:47:31.876620+0000","last_unstale":"2024-09-10T07:47:46.172587+0000","last_undegraded":"2024-09-10T07:47:46.172587+0000","last_fullsized":"2024-09-10T07:47:46.172587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:53.863927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174354+0000","last_change":"2024-09-10T07:47:31.871088+0000","last_active":"2024-09-10T07:47:46.174354+0000","last_peered":"2024-09-10T07:47:46.174354+0000","last_clean":"2024-09-10T07:47:46.174354+0000","last_became_active":"2024-09-10T07:47:31.870709+0000","last_became_peered":"2024-09-10T07:47:31.870709+0000","last_unstale":"2024-09-10T07:47:46.174354+0000","last_undegraded":"2024-09-10T07:47:46.174354+0000","last_fullsized":"2024-09-10T07:47:46.174354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:34.964229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174874+0000","last_change":"2024-09-10T07:47:31.869310+0000","last_active":"2024-09-10T07:47:46.174874+0000","last_peered":"2024-09-10T07:47:46.174874+0000","last_clean":"2024-09-10T07:47:46.174874+0000","last_became_active":"2024-09-10T07:47:31.868892+0000","last_became_peered":"2024-09-10T07:47:31.868892+0000","last_unstale":"2024-09-10T07:47:46.174874+0000","last_undegraded":"2024-09-10T07:47:46.174874+0000","last_fullsized":"2024-09-10T07:47:46.174874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:15.338010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177118+0000","last_change":"2024-09-10T07:47:31.867938+0000","last_active":"2024-09-10T07:47:46.177118+0000","last_peered":"2024-09-10T07:47:46.177118+0000","last_clean":"2024-09-10T07:47:46.177118+0000","last_became_active":"2024-09-10T07:47:31.867556+0000","last_became_peered":"2024-09-10T07:47:31.867556+0000","last_unstale":"2024-09-10T07:47:46.177118+0000","last_undegraded":"2024-09-10T07:47:46.177118+0000","last_fullsized":"2024-09-10T07:47:46.177118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:43.198241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173966+0000","last_change":"2024-09-10T07:47:31.864157+0000","last_active":"2024-09-10T07:47:46.173966+0000","last_peered":"2024-09-10T07:47:46.173966+0000","last_clean":"2024-09-10T07:47:46.173966+0000","last_became_active":"2024-09-10T07:47:31.863802+0000","last_became_peered":"2024-09-10T07:47:31.863802+0000","last_unstale":"2024-09-10T07:47:46.173966+0000","last_undegraded":"2024-09-10T07:47:46.173966+0000","last_fullsized":"2024-09-10T07:47:46.173966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:03.492869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192857+0000","last_change":"2024-09-10T07:47:31.865404+0000","last_active":"2024-09-10T07:47:46.192857+0000","last_peered":"2024-09-10T07:47:46.192857+0000","last_clean":"2024-09-10T07:47:46.192857+0000","last_became_active":"2024-09-10T07:47:31.865098+0000","last_became_peered":"2024-09-10T07:47:31.865098+0000","last_unstale":"2024-09-10T07:47:46.192857+0000","last_undegraded":"2024-09-10T07:47:46.192857+0000","last_fullsized":"2024-09-10T07:47:46.192857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:56.111270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172776+0000","last_change":"2024-09-10T07:47:31.869880+0000","last_active":"2024-09-10T07:47:46.172776+0000","last_peered":"2024-09-10T07:47:46.172776+0000","last_clean":"2024-09-10T07:47:46.172776+0000","last_became_active":"2024-09-10T07:47:31.869535+0000","last_became_peered":"2024-09-10T07:47:31.869535+0000","last_unstale":"2024-09-10T07:47:46.172776+0000","last_undegraded":"2024-09-10T07:47:46.172776+0000","last_fullsized":"2024-09-10T07:47:46.172776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:53.157821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171861+0000","last_change":"2024-09-10T07:47:31.867799+0000","last_active":"2024-09-10T07:47:46.171861+0000","last_peered":"2024-09-10T07:47:46.171861+0000","last_clean":"2024-09-10T07:47:46.171861+0000","last_became_active":"2024-09-10T07:47:31.867499+0000","last_became_peered":"2024-09-10T07:47:31.867499+0000","last_unstale":"2024-09-10T07:47:46.171861+0000","last_undegraded":"2024-09-10T07:47:46.171861+0000","last_fullsized":"2024-09-10T07:47:46.171861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:47.340340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177625+0000","last_change":"2024-09-10T07:47:46.176635+0000","last_active":"2024-09-10T07:47:46.177625+0000","last_peered":"2024-09-10T07:47:46.177625+0000","last_clean":"2024-09-10T07:47:46.177625+0000","last_became_active":"2024-09-10T07:47:46.176225+0000","last_became_peered":"2024-09-10T07:47:46.176225+0000","last_unstale":"2024-09-10T07:47:46.177625+0000","last_undegraded":"2024-09-10T07:47:46.177625+0000","last_fullsized":"2024-09-10T07:47:46.177625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:33.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172991+0000","last_change":"2024-09-10T07:47:31.864776+0000","last_active":"2024-09-10T07:47:46.172991+0000","last_peered":"2024-09-10T07:47:46.172991+0000","last_clean":"2024-09-10T07:47:46.172991+0000","last_became_active":"2024-09-10T07:47:31.864446+0000","last_became_peered":"2024-09-10T07:47:31.864446+0000","last_unstale":"2024-09-10T07:47:46.172991+0000","last_undegraded":"2024-09-10T07:47:46.172991+0000","last_fullsized":"2024-09-10T07:47:46.172991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:38.976206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177130+0000","last_change":"2024-09-10T07:47:31.871688+0000","last_active":"2024-09-10T07:47:46.177130+0000","last_peered":"2024-09-10T07:47:46.177130+0000","last_clean":"2024-09-10T07:47:46.177130+0000","last_became_active":"2024-09-10T07:47:31.871484+0000","last_became_peered":"2024-09-10T07:47:31.871484+0000","last_unstale":"2024-09-10T07:47:46.177130+0000","last_undegraded":"2024-09-10T07:47:46.177130+0000","last_fullsized":"2024-09-10T07:47:46.177130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:53.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174171+0000","last_change":"2024-09-10T07:47:31.868919+0000","last_active":"2024-09-10T07:47:46.174171+0000","last_peered":"2024-09-10T07:47:46.174171+0000","last_clean":"2024-09-10T07:47:46.174171+0000","last_became_active":"2024-09-10T07:47:31.868593+0000","last_became_peered":"2024-09-10T07:47:31.868593+0000","last_unstale":"2024-09-10T07:47:46.174171+0000","last_undegraded":"2024-09-10T07:47:46.174171+0000","last_fullsized":"2024-09-10T07:47:46.174171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:02.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192808+0000","last_change":"2024-09-10T07:47:31.863674+0000","last_active":"2024-09-10T07:47:46.192808+0000","last_peered":"2024-09-10T07:47:46.192808+0000","last_clean":"2024-09-10T07:47:46.192808+0000","last_became_active":"2024-09-10T07:47:31.863347+0000","last_became_peered":"2024-09-10T07:47:31.863347+0000","last_unstale":"2024-09-10T07:47:46.192808+0000","last_undegraded":"2024-09-10T07:47:46.192808+0000","last_fullsized":"2024-09-10T07:47:46.192808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:55.819510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176196+0000","last_change":"2024-09-10T07:47:31.869710+0000","last_active":"2024-09-10T07:47:46.176196+0000","last_peered":"2024-09-10T07:47:46.176196+0000","last_clean":"2024-09-10T07:47:46.176196+0000","last_became_active":"2024-09-10T07:47:31.869284+0000","last_became_peered":"2024-09-10T07:47:31.869284+0000","last_unstale":"2024-09-10T07:47:46.176196+0000","last_undegraded":"2024-09-10T07:47:46.176196+0000","last_fullsized":"2024-09-10T07:47:46.176196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:49.128941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176605+0000","last_change":"2024-09-10T07:47:31.865576+0000","last_active":"2024-09-10T07:47:46.176605+0000","last_peered":"2024-09-10T07:47:46.176605+0000","last_clean":"2024-09-10T07:47:46.176605+0000","last_became_active":"2024-09-10T07:47:31.865225+0000","last_became_peered":"2024-09-10T07:47:31.865225+0000","last_unstale":"2024-09-10T07:47:46.176605+0000","last_undegraded":"2024-09-10T07:47:46.176605+0000","last_fullsized":"2024-09-10T07:47:46.176605+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:10.390091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176806+0000","last_change":"2024-09-10T07:47:31.869155+0000","last_active":"2024-09-10T07:47:46.176806+0000","last_peered":"2024-09-10T07:47:46.176806+0000","last_clean":"2024-09-10T07:47:46.176806+0000","last_became_active":"2024-09-10T07:47:31.868737+0000","last_became_peered":"2024-09-10T07:47:31.868737+0000","last_unstale":"2024-09-10T07:47:46.176806+0000","last_undegraded":"2024-09-10T07:47:46.176806+0000","last_fullsized":"2024-09-10T07:47:46.176806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:16.123687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173764+0000","last_change":"2024-09-10T07:47:31.870079+0000","last_active":"2024-09-10T07:47:46.173764+0000","last_peered":"2024-09-10T07:47:46.173764+0000","last_clean":"2024-09-10T07:47:46.173764+0000","last_became_active":"2024-09-10T07:47:31.869554+0000","last_became_peered":"2024-09-10T07:47:31.869554+0000","last_unstale":"2024-09-10T07:47:46.173764+0000","last_undegraded":"2024-09-10T07:47:46.173764+0000","last_fullsized":"2024-09-10T07:47:46.173764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:54.685962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177344+0000","last_change":"2024-09-10T07:47:31.867605+0000","last_active":"2024-09-10T07:47:46.177344+0000","last_peered":"2024-09-10T07:47:46.177344+0000","last_clean":"2024-09-10T07:47:46.177344+0000","last_became_active":"2024-09-10T07:47:31.867296+0000","last_became_peered":"2024-09-10T07:47:31.867296+0000","last_unstale":"2024-09-10T07:47:46.177344+0000","last_undegraded":"2024-09-10T07:47:46.177344+0000","last_fullsized":"2024-09-10T07:47:46.177344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:59.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172952+0000","last_change":"2024-09-10T07:47:29.862795+0000","last_active":"2024-09-10T07:47:46.172952+0000","last_peered":"2024-09-10T07:47:46.172952+0000","last_clean":"2024-09-10T07:47:46.172952+0000","last_became_active":"2024-09-10T07:47:29.862437+0000","last_became_peered":"2024-09-10T07:47:29.862437+0000","last_unstale":"2024-09-10T07:47:46.172952+0000","last_undegraded":"2024-09-10T07:47:46.172952+0000","last_fullsized":"2024-09-10T07:47:46.172952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:34.233270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172849+0000","last_change":"2024-09-10T07:47:31.868932+0000","last_active":"2024-09-10T07:47:46.172849+0000","last_peered":"2024-09-10T07:47:46.172849+0000","last_clean":"2024-09-10T07:47:46.172849+0000","last_became_active":"2024-09-10T07:47:31.868534+0000","last_became_peered":"2024-09-10T07:47:31.868534+0000","last_unstale":"2024-09-10T07:47:46.172849+0000","last_undegraded":"2024-09-10T07:47:46.172849+0000","last_fullsized":"2024-09-10T07:47:46.172849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:12.164453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177434+0000","last_change":"2024-09-10T07:47:29.858029+0000","last_active":"2024-09-10T07:47:46.177434+0000","last_peered":"2024-09-10T07:47:46.177434+0000","last_clean":"2024-09-10T07:47:46.177434+0000","last_became_active":"2024-09-10T07:47:29.857556+0000","last_became_peered":"2024-09-10T07:47:29.857556+0000","last_unstale":"2024-09-10T07:47:46.177434+0000","last_undegraded":"2024-09-10T07:47:46.177434+0000","last_fullsized":"2024-09-10T07:47:46.177434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:37.831252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192589+0000","last_change":"2024-09-10T07:47:29.856390+0000","last_active":"2024-09-10T07:47:46.192589+0000","last_peered":"2024-09-10T07:47:46.192589+0000","last_clean":"2024-09-10T07:47:46.192589+0000","last_became_active":"2024-09-10T07:47:29.856042+0000","last_became_peered":"2024-09-10T07:47:29.856042+0000","last_unstale":"2024-09-10T07:47:46.192589+0000","last_undegraded":"2024-09-10T07:47:46.192589+0000","last_fullsized":"2024-09-10T07:47:46.192589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:57.934410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171927+0000","last_change":"2024-09-10T07:47:31.863414+0000","last_active":"2024-09-10T07:47:46.171927+0000","last_peered":"2024-09-10T07:47:46.171927+0000","last_clean":"2024-09-10T07:47:46.171927+0000","last_became_active":"2024-09-10T07:47:31.863116+0000","last_became_peered":"2024-09-10T07:47:31.863116+0000","last_unstale":"2024-09-10T07:47:46.171927+0000","last_undegraded":"2024-09-10T07:47:46.171927+0000","last_fullsized":"2024-09-10T07:47:46.171927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:02.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172688+0000","last_change":"2024-09-10T07:47:29.860106+0000","last_active":"2024-09-10T07:47:46.172688+0000","last_peered":"2024-09-10T07:47:46.172688+0000","last_clean":"2024-09-10T07:47:46.172688+0000","last_became_active":"2024-09-10T07:47:29.859700+0000","last_became_peered":"2024-09-10T07:47:29.859700+0000","last_unstale":"2024-09-10T07:47:46.172688+0000","last_undegraded":"2024-09-10T07:47:46.172688+0000","last_fullsized":"2024-09-10T07:47:46.172688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:07.832889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174363+0000","last_change":"2024-09-10T07:47:31.866263+0000","last_active":"2024-09-10T07:47:46.174363+0000","last_peered":"2024-09-10T07:47:46.174363+0000","last_clean":"2024-09-10T07:47:46.174363+0000","last_became_active":"2024-09-10T07:47:31.865911+0000","last_became_peered":"2024-09-10T07:47:31.865911+0000","last_unstale":"2024-09-10T07:47:46.174363+0000","last_undegraded":"2024-09-10T07:47:46.174363+0000","last_fullsized":"2024-09-10T07:47:46.174363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:53.644360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177424+0000","last_change":"2024-09-10T07:47:29.861490+0000","last_active":"2024-09-10T07:47:46.177424+0000","last_peered":"2024-09-10T07:47:46.177424+0000","last_clean":"2024-09-10T07:47:46.177424+0000","last_became_active":"2024-09-10T07:47:29.861042+0000","last_became_peered":"2024-09-10T07:47:29.861042+0000","last_unstale":"2024-09-10T07:47:46.177424+0000","last_undegraded":"2024-09-10T07:47:46.177424+0000","last_fullsized":"2024-09-10T07:47:46.177424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:12.626954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173037+0000","last_change":"2024-09-10T07:47:31.871792+0000","last_active":"2024-09-10T07:47:46.173037+0000","last_peered":"2024-09-10T07:47:46.173037+0000","last_clean":"2024-09-10T07:47:46.173037+0000","last_became_active":"2024-09-10T07:47:31.870859+0000","last_became_peered":"2024-09-10T07:47:31.870859+0000","last_unstale":"2024-09-10T07:47:46.173037+0000","last_undegraded":"2024-09-10T07:47:46.173037+0000","last_fullsized":"2024-09-10T07:47:46.173037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:08.479377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174617+0000","last_change":"2024-09-10T07:47:29.862475+0000","last_active":"2024-09-10T07:47:46.174617+0000","last_peered":"2024-09-10T07:47:46.174617+0000","last_clean":"2024-09-10T07:47:46.174617+0000","last_became_active":"2024-09-10T07:47:29.862094+0000","last_became_peered":"2024-09-10T07:47:29.862094+0000","last_unstale":"2024-09-10T07:47:46.174617+0000","last_undegraded":"2024-09-10T07:47:46.174617+0000","last_fullsized":"2024-09-10T07:47:46.174617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:25.933844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176742+0000","last_change":"2024-09-10T07:47:31.868963+0000","last_active":"2024-09-10T07:47:46.176742+0000","last_peered":"2024-09-10T07:47:46.176742+0000","last_clean":"2024-09-10T07:47:46.176742+0000","last_became_active":"2024-09-10T07:47:31.868650+0000","last_became_peered":"2024-09-10T07:47:31.868650+0000","last_unstale":"2024-09-10T07:47:46.176742+0000","last_undegraded":"2024-09-10T07:47:46.176742+0000","last_fullsized":"2024-09-10T07:47:46.176742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:39.613235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172874+0000","last_change":"2024-09-10T07:47:29.861572+0000","last_active":"2024-09-10T07:47:46.172874+0000","last_peered":"2024-09-10T07:47:46.172874+0000","last_clean":"2024-09-10T07:47:46.172874+0000","last_became_active":"2024-09-10T07:47:29.860710+0000","last_became_peered":"2024-09-10T07:47:29.860710+0000","last_unstale":"2024-09-10T07:47:46.172874+0000","last_undegraded":"2024-09-10T07:47:46.172874+0000","last_fullsized":"2024-09-10T07:47:46.172874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:28.535090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173093+0000","last_change":"2024-09-10T07:47:31.869976+0000","last_active":"2024-09-10T07:47:46.173093+0000","last_peered":"2024-09-10T07:47:46.173093+0000","last_clean":"2024-09-10T07:47:46.173093+0000","last_became_active":"2024-09-10T07:47:31.868678+0000","last_became_peered":"2024-09-10T07:47:31.868678+0000","last_unstale":"2024-09-10T07:47:46.173093+0000","last_undegraded":"2024-09-10T07:47:46.173093+0000","last_fullsized":"2024-09-10T07:47:46.173093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:38.362180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'25","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:52.554239+0000","last_change":"2024-09-10T07:47:29.863534+0000","last_active":"2024-09-10T07:47:52.554239+0000","last_peered":"2024-09-10T07:47:52.554239+0000","last_clean":"2024-09-10T07:47:52.554239+0000","last_became_active":"2024-09-10T07:47:29.863136+0000","last_became_peered":"2024-09-10T07:47:29.863136+0000","last_unstale":"2024-09-10T07:47:52.554239+0000","last_undegraded":"2024-09-10T07:47:52.554239+0000","last_fullsized":"2024-09-10T07:47:52.554239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:21.261019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":55,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178297+0000","last_change":"2024-09-10T07:47:31.866435+0000","last_active":"2024-09-10T07:47:46.178297+0000","last_peered":"2024-09-10T07:47:46.178297+0000","last_clean":"2024-09-10T07:47:46.178297+0000","last_became_active":"2024-09-10T07:47:31.866099+0000","last_became_peered":"2024-09-10T07:47:31.866099+0000","last_unstale":"2024-09-10T07:47:46.178297+0000","last_undegraded":"2024-09-10T07:47:46.178297+0000","last_fullsized":"2024-09-10T07:47:46.178297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177210+0000","last_change":"2024-09-10T07:47:29.862633+0000","last_active":"2024-09-10T07:47:46.177210+0000","last_peered":"2024-09-10T07:47:46.177210+0000","last_clean":"2024-09-10T07:47:46.177210+0000","last_became_active":"2024-09-10T07:47:29.862214+0000","last_became_peered":"2024-09-10T07:47:29.862214+0000","last_unstale":"2024-09-10T07:47:46.177210+0000","last_undegraded":"2024-09-10T07:47:46.177210+0000","last_fullsized":"2024-09-10T07:47:46.177210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:34.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192682+0000","last_change":"2024-09-10T07:47:31.863361+0000","last_active":"2024-09-10T07:47:46.192682+0000","last_peered":"2024-09-10T07:47:46.192682+0000","last_clean":"2024-09-10T07:47:46.192682+0000","last_became_active":"2024-09-10T07:47:31.863048+0000","last_became_peered":"2024-09-10T07:47:31.863048+0000","last_unstale":"2024-09-10T07:47:46.192682+0000","last_undegraded":"2024-09-10T07:47:46.192682+0000","last_fullsized":"2024-09-10T07:47:46.192682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:54.770006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173311+0000","last_change":"2024-09-10T07:47:29.858767+0000","last_active":"2024-09-10T07:47:46.173311+0000","last_peered":"2024-09-10T07:47:46.173311+0000","last_clean":"2024-09-10T07:47:46.173311+0000","last_became_active":"2024-09-10T07:47:29.858419+0000","last_became_peered":"2024-09-10T07:47:29.858419+0000","last_unstale":"2024-09-10T07:47:46.173311+0000","last_undegraded":"2024-09-10T07:47:46.173311+0000","last_fullsized":"2024-09-10T07:47:46.173311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:03.642873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174068+0000","last_change":"2024-09-10T07:47:31.870593+0000","last_active":"2024-09-10T07:47:46.174068+0000","last_peered":"2024-09-10T07:47:46.174068+0000","last_clean":"2024-09-10T07:47:46.174068+0000","last_became_active":"2024-09-10T07:47:31.870285+0000","last_became_peered":"2024-09-10T07:47:31.870285+0000","last_unstale":"2024-09-10T07:47:46.174068+0000","last_undegraded":"2024-09-10T07:47:46.174068+0000","last_fullsized":"2024-09-10T07:47:46.174068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:49.370065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192726+0000","last_change":"2024-09-10T07:47:29.856937+0000","last_active":"2024-09-10T07:47:46.192726+0000","last_peered":"2024-09-10T07:47:46.192726+0000","last_clean":"2024-09-10T07:47:46.192726+0000","last_became_active":"2024-09-10T07:47:29.856559+0000","last_became_peered":"2024-09-10T07:47:29.856559+0000","last_unstale":"2024-09-10T07:47:46.192726+0000","last_undegraded":"2024-09-10T07:47:46.192726+0000","last_fullsized":"2024-09-10T07:47:46.192726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:01.135693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174684+0000","last_change":"2024-09-10T07:47:31.871743+0000","last_active":"2024-09-10T07:47:46.174684+0000","last_peered":"2024-09-10T07:47:46.174684+0000","last_clean":"2024-09-10T07:47:46.174684+0000","last_became_active":"2024-09-10T07:47:31.871395+0000","last_became_peered":"2024-09-10T07:47:31.871395+0000","last_unstale":"2024-09-10T07:47:46.174684+0000","last_undegraded":"2024-09-10T07:47:46.174684+0000","last_fullsized":"2024-09-10T07:47:46.174684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:18.450216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176747+0000","last_change":"2024-09-10T07:47:29.863405+0000","last_active":"2024-09-10T07:47:46.176747+0000","last_peered":"2024-09-10T07:47:46.176747+0000","last_clean":"2024-09-10T07:47:46.176747+0000","last_became_active":"2024-09-10T07:47:29.862832+0000","last_became_peered":"2024-09-10T07:47:29.862832+0000","last_unstale":"2024-09-10T07:47:46.176747+0000","last_undegraded":"2024-09-10T07:47:46.176747+0000","last_fullsized":"2024-09-10T07:47:46.176747+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:10.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173136+0000","last_change":"2024-09-10T07:47:31.872412+0000","last_active":"2024-09-10T07:47:46.173136+0000","last_peered":"2024-09-10T07:47:46.173136+0000","last_clean":"2024-09-10T07:47:46.173136+0000","last_became_active":"2024-09-10T07:47:31.871380+0000","last_became_peered":"2024-09-10T07:47:31.871380+0000","last_unstale":"2024-09-10T07:47:46.173136+0000","last_undegraded":"2024-09-10T07:47:46.173136+0000","last_fullsized":"2024-09-10T07:47:46.173136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:09.730443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178875+0000","last_change":"2024-09-10T07:47:29.861556+0000","last_active":"2024-09-10T07:47:46.178875+0000","last_peered":"2024-09-10T07:47:46.178875+0000","last_clean":"2024-09-10T07:47:46.178875+0000","last_became_active":"2024-09-10T07:47:29.861053+0000","last_became_peered":"2024-09-10T07:47:29.861053+0000","last_unstale":"2024-09-10T07:47:46.178875+0000","last_undegraded":"2024-09-10T07:47:46.178875+0000","last_fullsized":"2024-09-10T07:47:46.178875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:21.969667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174106+0000","last_change":"2024-09-10T07:47:31.868023+0000","last_active":"2024-09-10T07:47:46.174106+0000","last_peered":"2024-09-10T07:47:46.174106+0000","last_clean":"2024-09-10T07:47:46.174106+0000","last_became_active":"2024-09-10T07:47:31.867722+0000","last_became_peered":"2024-09-10T07:47:31.867722+0000","last_unstale":"2024-09-10T07:47:46.174106+0000","last_undegraded":"2024-09-10T07:47:46.174106+0000","last_fullsized":"2024-09-10T07:47:46.174106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:01.399800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192980+0000","last_change":"2024-09-10T07:47:29.862054+0000","last_active":"2024-09-10T07:47:46.192980+0000","last_peered":"2024-09-10T07:47:46.192980+0000","last_clean":"2024-09-10T07:47:46.192980+0000","last_became_active":"2024-09-10T07:47:29.861731+0000","last_became_peered":"2024-09-10T07:47:29.861731+0000","last_unstale":"2024-09-10T07:47:46.192980+0000","last_undegraded":"2024-09-10T07:47:46.192980+0000","last_fullsized":"2024-09-10T07:47:46.192980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:45.043458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174768+0000","last_change":"2024-09-10T07:47:31.871372+0000","last_active":"2024-09-10T07:47:46.174768+0000","last_peered":"2024-09-10T07:47:46.174768+0000","last_clean":"2024-09-10T07:47:46.174768+0000","last_became_active":"2024-09-10T07:47:31.871048+0000","last_became_peered":"2024-09-10T07:47:31.871048+0000","last_unstale":"2024-09-10T07:47:46.174768+0000","last_undegraded":"2024-09-10T07:47:46.174768+0000","last_fullsized":"2024-09-10T07:47:46.174768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:58.934809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172999+0000","last_change":"2024-09-10T07:47:29.861974+0000","last_active":"2024-09-10T07:47:46.172999+0000","last_peered":"2024-09-10T07:47:46.172999+0000","last_clean":"2024-09-10T07:47:46.172999+0000","last_became_active":"2024-09-10T07:47:29.861240+0000","last_became_peered":"2024-09-10T07:47:29.861240+0000","last_unstale":"2024-09-10T07:47:46.172999+0000","last_undegraded":"2024-09-10T07:47:46.172999+0000","last_fullsized":"2024-09-10T07:47:46.172999+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:05.235927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174244+0000","last_change":"2024-09-10T07:47:31.871807+0000","last_active":"2024-09-10T07:47:46.174244+0000","last_peered":"2024-09-10T07:47:46.174244+0000","last_clean":"2024-09-10T07:47:46.174244+0000","last_became_active":"2024-09-10T07:47:31.871489+0000","last_became_peered":"2024-09-10T07:47:31.871489+0000","last_unstale":"2024-09-10T07:47:46.174244+0000","last_undegraded":"2024-09-10T07:47:46.174244+0000","last_fullsized":"2024-09-10T07:47:46.174244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:00.754188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176930+0000","last_change":"2024-09-10T07:47:30.089332+0000","last_active":"2024-09-10T07:47:46.176930+0000","last_peered":"2024-09-10T07:47:46.176930+0000","last_clean":"2024-09-10T07:47:46.176930+0000","last_became_active":"2024-09-10T07:47:30.088879+0000","last_became_peered":"2024-09-10T07:47:30.088879+0000","last_unstale":"2024-09-10T07:47:46.176930+0000","last_undegraded":"2024-09-10T07:47:46.176930+0000","last_fullsized":"2024-09-10T07:47:46.176930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:40.875957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174405+0000","last_change":"2024-09-10T07:47:31.873732+0000","last_active":"2024-09-10T07:47:46.174405+0000","last_peered":"2024-09-10T07:47:46.174405+0000","last_clean":"2024-09-10T07:47:46.174405+0000","last_became_active":"2024-09-10T07:47:31.873291+0000","last_became_peered":"2024-09-10T07:47:31.873291+0000","last_unstale":"2024-09-10T07:47:46.174405+0000","last_undegraded":"2024-09-10T07:47:46.174405+0000","last_fullsized":"2024-09-10T07:47:46.174405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:02.095237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174815+0000","last_change":"2024-09-10T07:46:21.922704+0000","last_active":"2024-09-10T07:47:46.174815+0000","last_peered":"2024-09-10T07:47:46.174815+0000","last_clean":"2024-09-10T07:47:46.174815+0000","last_became_active":"2024-09-10T07:46:21.922144+0000","last_became_peered":"2024-09-10T07:46:21.922144+0000","last_unstale":"2024-09-10T07:47:46.174815+0000","last_undegraded":"2024-09-10T07:47:46.174815+0000","last_fullsized":"2024-09-10T07:47:46.174815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:42:58.927087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:42:58.927087+0000","last_clean_scrub_stamp":"2024-09-10T07:42:58.927087+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:11.355989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192853+0000","last_change":"2024-09-10T07:47:29.859739+0000","last_active":"2024-09-10T07:47:46.192853+0000","last_peered":"2024-09-10T07:47:46.192853+0000","last_clean":"2024-09-10T07:47:46.192853+0000","last_became_active":"2024-09-10T07:47:29.859223+0000","last_became_peered":"2024-09-10T07:47:29.859223+0000","last_unstale":"2024-09-10T07:47:46.192853+0000","last_undegraded":"2024-09-10T07:47:46.192853+0000","last_fullsized":"2024-09-10T07:47:46.192853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:48.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176834+0000","last_change":"2024-09-10T07:47:46.176368+0000","last_active":"2024-09-10T07:47:46.176834+0000","last_peered":"2024-09-10T07:47:46.176834+0000","last_clean":"2024-09-10T07:47:46.176834+0000","last_became_active":"2024-09-10T07:47:46.176008+0000","last_became_peered":"2024-09-10T07:47:46.176008+0000","last_unstale":"2024-09-10T07:47:46.176834+0000","last_undegraded":"2024-09-10T07:47:46.176834+0000","last_fullsized":"2024-09-10T07:47:46.176834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:45.707644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174793+0000","last_change":"2024-09-10T07:47:29.861314+0000","last_active":"2024-09-10T07:47:46.174793+0000","last_peered":"2024-09-10T07:47:46.174793+0000","last_clean":"2024-09-10T07:47:46.174793+0000","last_became_active":"2024-09-10T07:47:29.860946+0000","last_became_peered":"2024-09-10T07:47:29.860946+0000","last_unstale":"2024-09-10T07:47:46.174793+0000","last_undegraded":"2024-09-10T07:47:46.174793+0000","last_fullsized":"2024-09-10T07:47:46.174793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:38.530660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192570+0000","last_change":"2024-09-10T07:47:31.867374+0000","last_active":"2024-09-10T07:47:46.192570+0000","last_peered":"2024-09-10T07:47:46.192570+0000","last_clean":"2024-09-10T07:47:46.192570+0000","last_became_active":"2024-09-10T07:47:31.867065+0000","last_became_peered":"2024-09-10T07:47:31.867065+0000","last_unstale":"2024-09-10T07:47:46.192570+0000","last_undegraded":"2024-09-10T07:47:46.192570+0000","last_fullsized":"2024-09-10T07:47:46.192570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:07.688314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192682+0000","last_change":"2024-09-10T07:47:29.854853+0000","last_active":"2024-09-10T07:47:46.192682+0000","last_peered":"2024-09-10T07:47:46.192682+0000","last_clean":"2024-09-10T07:47:46.192682+0000","last_became_active":"2024-09-10T07:47:29.854553+0000","last_became_peered":"2024-09-10T07:47:29.854553+0000","last_unstale":"2024-09-10T07:47:46.192682+0000","last_undegraded":"2024-09-10T07:47:46.192682+0000","last_fullsized":"2024-09-10T07:47:46.192682+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:34.570076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172538+0000","last_change":"2024-09-10T07:47:31.868522+0000","last_active":"2024-09-10T07:47:46.172538+0000","last_peered":"2024-09-10T07:47:46.172538+0000","last_clean":"2024-09-10T07:47:46.172538+0000","last_became_active":"2024-09-10T07:47:31.868114+0000","last_became_peered":"2024-09-10T07:47:31.868114+0000","last_unstale":"2024-09-10T07:47:46.172538+0000","last_undegraded":"2024-09-10T07:47:46.172538+0000","last_fullsized":"2024-09-10T07:47:46.172538+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.442513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174097+0000","last_change":"2024-09-10T07:47:29.856185+0000","last_active":"2024-09-10T07:47:46.174097+0000","last_peered":"2024-09-10T07:47:46.174097+0000","last_clean":"2024-09-10T07:47:46.174097+0000","last_became_active":"2024-09-10T07:47:29.855809+0000","last_became_peered":"2024-09-10T07:47:29.855809+0000","last_unstale":"2024-09-10T07:47:46.174097+0000","last_undegraded":"2024-09-10T07:47:46.174097+0000","last_fullsized":"2024-09-10T07:47:46.174097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:55.325391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177351+0000","last_change":"2024-09-10T07:47:31.862955+0000","last_active":"2024-09-10T07:47:46.177351+0000","last_peered":"2024-09-10T07:47:46.177351+0000","last_clean":"2024-09-10T07:47:46.177351+0000","last_became_active":"2024-09-10T07:47:31.862671+0000","last_became_peered":"2024-09-10T07:47:31.862671+0000","last_unstale":"2024-09-10T07:47:46.177351+0000","last_undegraded":"2024-09-10T07:47:46.177351+0000","last_fullsized":"2024-09-10T07:47:46.177351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:54.858623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174440+0000","last_change":"2024-09-10T07:47:29.861345+0000","last_active":"2024-09-10T07:47:46.174440+0000","last_peered":"2024-09-10T07:47:46.174440+0000","last_clean":"2024-09-10T07:47:46.174440+0000","last_became_active":"2024-09-10T07:47:29.860987+0000","last_became_peered":"2024-09-10T07:47:29.860987+0000","last_unstale":"2024-09-10T07:47:46.174440+0000","last_undegraded":"2024-09-10T07:47:46.174440+0000","last_fullsized":"2024-09-10T07:47:46.174440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:33.202676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176992+0000","last_change":"2024-09-10T07:47:31.861217+0000","last_active":"2024-09-10T07:47:46.176992+0000","last_peered":"2024-09-10T07:47:46.176992+0000","last_clean":"2024-09-10T07:47:46.176992+0000","last_became_active":"2024-09-10T07:47:31.860572+0000","last_became_peered":"2024-09-10T07:47:31.860572+0000","last_unstale":"2024-09-10T07:47:46.176992+0000","last_undegraded":"2024-09-10T07:47:46.176992+0000","last_fullsized":"2024-09-10T07:47:46.176992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:39.537642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.179624+0000","last_change":"2024-09-10T07:47:29.855256+0000","last_active":"2024-09-10T07:47:46.179624+0000","last_peered":"2024-09-10T07:47:46.179624+0000","last_clean":"2024-09-10T07:47:46.179624+0000","last_became_active":"2024-09-10T07:47:29.854922+0000","last_became_peered":"2024-09-10T07:47:29.854922+0000","last_unstale":"2024-09-10T07:47:46.179624+0000","last_undegraded":"2024-09-10T07:47:46.179624+0000","last_fullsized":"2024-09-10T07:47:46.179624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:44.264077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192868+0000","last_change":"2024-09-10T07:47:31.866057+0000","last_active":"2024-09-10T07:47:46.192868+0000","last_peered":"2024-09-10T07:47:46.192868+0000","last_clean":"2024-09-10T07:47:46.192868+0000","last_became_active":"2024-09-10T07:47:31.865696+0000","last_became_peered":"2024-09-10T07:47:31.865696+0000","last_unstale":"2024-09-10T07:47:46.192868+0000","last_undegraded":"2024-09-10T07:47:46.192868+0000","last_fullsized":"2024-09-10T07:47:46.192868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:31.904881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:51.127458+0000","last_change":"2024-09-10T07:47:29.853800+0000","last_active":"2024-09-10T07:47:51.127458+0000","last_peered":"2024-09-10T07:47:51.127458+0000","last_clean":"2024-09-10T07:47:51.127458+0000","last_became_active":"2024-09-10T07:47:29.853480+0000","last_became_peered":"2024-09-10T07:47:29.853480+0000","last_unstale":"2024-09-10T07:47:51.127458+0000","last_undegraded":"2024-09-10T07:47:51.127458+0000","last_fullsized":"2024-09-10T07:47:51.127458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:31.683236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173078+0000","last_change":"2024-09-10T07:47:31.864686+0000","last_active":"2024-09-10T07:47:46.173078+0000","last_peered":"2024-09-10T07:47:46.173078+0000","last_clean":"2024-09-10T07:47:46.173078+0000","last_became_active":"2024-09-10T07:47:31.864188+0000","last_became_peered":"2024-09-10T07:47:31.864188+0000","last_unstale":"2024-09-10T07:47:46.173078+0000","last_undegraded":"2024-09-10T07:47:46.173078+0000","last_fullsized":"2024-09-10T07:47:46.173078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:15.838121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.193128+0000","last_change":"2024-09-10T07:47:30.089172+0000","last_active":"2024-09-10T07:47:46.193128+0000","last_peered":"2024-09-10T07:47:46.193128+0000","last_clean":"2024-09-10T07:47:46.193128+0000","last_became_active":"2024-09-10T07:47:30.088859+0000","last_became_peered":"2024-09-10T07:47:30.088859+0000","last_unstale":"2024-09-10T07:47:46.193128+0000","last_undegraded":"2024-09-10T07:47:46.193128+0000","last_fullsized":"2024-09-10T07:47:46.193128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:22.415581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176427+0000","last_change":"2024-09-10T07:47:31.863676+0000","last_active":"2024-09-10T07:47:46.176427+0000","last_peered":"2024-09-10T07:47:46.176427+0000","last_clean":"2024-09-10T07:47:46.176427+0000","last_became_active":"2024-09-10T07:47:31.863399+0000","last_became_peered":"2024-09-10T07:47:31.863399+0000","last_unstale":"2024-09-10T07:47:46.176427+0000","last_undegraded":"2024-09-10T07:47:46.176427+0000","last_fullsized":"2024-09-10T07:47:46.176427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:40.168078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172713+0000","last_change":"2024-09-10T07:47:29.862578+0000","last_active":"2024-09-10T07:47:46.172713+0000","last_peered":"2024-09-10T07:47:46.172713+0000","last_clean":"2024-09-10T07:47:46.172713+0000","last_became_active":"2024-09-10T07:47:29.862157+0000","last_became_peered":"2024-09-10T07:47:29.862157+0000","last_unstale":"2024-09-10T07:47:46.172713+0000","last_undegraded":"2024-09-10T07:47:46.172713+0000","last_fullsized":"2024-09-10T07:47:46.172713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:47.201556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176894+0000","last_change":"2024-09-10T07:47:31.865766+0000","last_active":"2024-09-10T07:47:46.176894+0000","last_peered":"2024-09-10T07:47:46.176894+0000","last_clean":"2024-09-10T07:47:46.176894+0000","last_became_active":"2024-09-10T07:47:31.865416+0000","last_became_peered":"2024-09-10T07:47:31.865416+0000","last_unstale":"2024-09-10T07:47:46.176894+0000","last_undegraded":"2024-09-10T07:47:46.176894+0000","last_fullsized":"2024-09-10T07:47:46.176894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.274836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171982+0000","last_change":"2024-09-10T07:47:29.856768+0000","last_active":"2024-09-10T07:47:46.171982+0000","last_peered":"2024-09-10T07:47:46.171982+0000","last_clean":"2024-09-10T07:47:46.171982+0000","last_became_active":"2024-09-10T07:47:29.856457+0000","last_became_peered":"2024-09-10T07:47:29.856457+0000","last_unstale":"2024-09-10T07:47:46.171982+0000","last_undegraded":"2024-09-10T07:47:46.171982+0000","last_fullsized":"2024-09-10T07:47:46.171982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:17.227156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173830+0000","last_change":"2024-09-10T07:47:31.865457+0000","last_active":"2024-09-10T07:47:46.173830+0000","last_peered":"2024-09-10T07:47:46.173830+0000","last_clean":"2024-09-10T07:47:46.173830+0000","last_became_active":"2024-09-10T07:47:31.864801+0000","last_became_peered":"2024-09-10T07:47:31.864801+0000","last_unstale":"2024-09-10T07:47:46.173830+0000","last_undegraded":"2024-09-10T07:47:46.173830+0000","last_fullsized":"2024-09-10T07:47:46.173830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:59.236321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.182025+0000","last_change":"2024-09-10T07:47:46.180534+0000","last_active":"2024-09-10T07:47:46.182025+0000","last_peered":"2024-09-10T07:47:46.182025+0000","last_clean":"2024-09-10T07:47:46.182025+0000","last_became_active":"2024-09-10T07:47:46.180067+0000","last_became_peered":"2024-09-10T07:47:46.180067+0000","last_unstale":"2024-09-10T07:47:46.182025+0000","last_undegraded":"2024-09-10T07:47:46.182025+0000","last_fullsized":"2024-09-10T07:47:46.182025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:39.221934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172418+0000","last_change":"2024-09-10T07:47:31.864617+0000","last_active":"2024-09-10T07:47:46.172418+0000","last_peered":"2024-09-10T07:47:46.172418+0000","last_clean":"2024-09-10T07:47:46.172418+0000","last_became_active":"2024-09-10T07:47:31.864284+0000","last_became_peered":"2024-09-10T07:47:31.864284+0000","last_unstale":"2024-09-10T07:47:46.172418+0000","last_undegraded":"2024-09-10T07:47:46.172418+0000","last_fullsized":"2024-09-10T07:47:46.172418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:31.406445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.185054+0000","last_change":"2024-09-10T07:47:46.184591+0000","last_active":"2024-09-10T07:47:46.185054+0000","last_peered":"2024-09-10T07:47:46.185054+0000","last_clean":"2024-09-10T07:47:46.185054+0000","last_became_active":"2024-09-10T07:47:46.179474+0000","last_became_peered":"2024-09-10T07:47:46.179474+0000","last_unstale":"2024-09-10T07:47:46.185054+0000","last_undegraded":"2024-09-10T07:47:46.185054+0000","last_fullsized":"2024-09-10T07:47:46.185054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:02.752937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173972+0000","last_change":"2024-09-10T07:47:31.869921+0000","last_active":"2024-09-10T07:47:46.173972+0000","last_peered":"2024-09-10T07:47:46.173972+0000","last_clean":"2024-09-10T07:47:46.173972+0000","last_became_active":"2024-09-10T07:47:31.869602+0000","last_became_peered":"2024-09-10T07:47:31.869602+0000","last_unstale":"2024-09-10T07:47:46.173972+0000","last_undegraded":"2024-09-10T07:47:46.173972+0000","last_fullsized":"2024-09-10T07:47:46.173972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:50.590335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.181800+0000","last_change":"2024-09-10T07:47:46.181800+0000","last_active":"2024-09-10T07:47:46.181800+0000","last_peered":"2024-09-10T07:47:46.181800+0000","last_clean":"2024-09-10T07:47:46.181800+0000","last_became_active":"2024-09-10T07:47:46.181358+0000","last_became_peered":"2024-09-10T07:47:46.181358+0000","last_unstale":"2024-09-10T07:47:46.181800+0000","last_undegraded":"2024-09-10T07:47:46.181800+0000","last_fullsized":"2024-09-10T07:47:46.181800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:23.311525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178303+0000","last_change":"2024-09-10T07:47:29.862301+0000","last_active":"2024-09-10T07:47:46.178303+0000","last_peered":"2024-09-10T07:47:46.178303+0000","last_clean":"2024-09-10T07:47:46.178303+0000","last_became_active":"2024-09-10T07:47:29.861113+0000","last_became_peered":"2024-09-10T07:47:29.861113+0000","last_unstale":"2024-09-10T07:47:46.178303+0000","last_undegraded":"2024-09-10T07:47:46.178303+0000","last_fullsized":"2024-09-10T07:47:46.178303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:14.923430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172699+0000","last_change":"2024-09-10T07:47:31.871097+0000","last_active":"2024-09-10T07:47:46.172699+0000","last_peered":"2024-09-10T07:47:46.172699+0000","last_clean":"2024-09-10T07:47:46.172699+0000","last_became_active":"2024-09-10T07:47:31.869399+0000","last_became_peered":"2024-09-10T07:47:31.869399+0000","last_unstale":"2024-09-10T07:47:46.172699+0000","last_undegraded":"2024-09-10T07:47:46.172699+0000","last_fullsized":"2024-09-10T07:47:46.172699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:07.967838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.186555+0000","last_change":"2024-09-10T07:47:46.186555+0000","last_active":"2024-09-10T07:47:46.186555+0000","last_peered":"2024-09-10T07:47:46.186555+0000","last_clean":"2024-09-10T07:47:46.186555+0000","last_became_active":"2024-09-10T07:47:46.182966+0000","last_became_peered":"2024-09-10T07:47:46.182966+0000","last_unstale":"2024-09-10T07:47:46.186555+0000","last_undegraded":"2024-09-10T07:47:46.186555+0000","last_fullsized":"2024-09-10T07:47:46.186555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:32.435739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176715+0000","last_change":"2024-09-10T07:47:31.873450+0000","last_active":"2024-09-10T07:47:46.176715+0000","last_peered":"2024-09-10T07:47:46.176715+0000","last_clean":"2024-09-10T07:47:46.176715+0000","last_became_active":"2024-09-10T07:47:31.873134+0000","last_became_peered":"2024-09-10T07:47:31.873134+0000","last_unstale":"2024-09-10T07:47:46.176715+0000","last_undegraded":"2024-09-10T07:47:46.176715+0000","last_fullsized":"2024-09-10T07:47:46.176715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:19.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173185+0000","last_change":"2024-09-10T07:47:29.861395+0000","last_active":"2024-09-10T07:47:46.173185+0000","last_peered":"2024-09-10T07:47:46.173185+0000","last_clean":"2024-09-10T07:47:46.173185+0000","last_became_active":"2024-09-10T07:47:29.861002+0000","last_became_peered":"2024-09-10T07:47:29.861002+0000","last_unstale":"2024-09-10T07:47:46.173185+0000","last_undegraded":"2024-09-10T07:47:46.173185+0000","last_fullsized":"2024-09-10T07:47:46.173185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:59.347663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172934+0000","last_change":"2024-09-10T07:47:31.872400+0000","last_active":"2024-09-10T07:47:46.172934+0000","last_peered":"2024-09-10T07:47:46.172934+0000","last_clean":"2024-09-10T07:47:46.172934+0000","last_became_active":"2024-09-10T07:47:31.871995+0000","last_became_peered":"2024-09-10T07:47:31.871995+0000","last_unstale":"2024-09-10T07:47:46.172934+0000","last_undegraded":"2024-09-10T07:47:46.172934+0000","last_fullsized":"2024-09-10T07:47:46.172934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:51.421387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.198560+0000","last_change":"2024-09-10T07:47:46.198560+0000","last_active":"2024-09-10T07:47:46.198560+0000","last_peered":"2024-09-10T07:47:46.198560+0000","last_clean":"2024-09-10T07:47:46.198560+0000","last_became_active":"2024-09-10T07:47:46.194070+0000","last_became_peered":"2024-09-10T07:47:46.194070+0000","last_unstale":"2024-09-10T07:47:46.198560+0000","last_undegraded":"2024-09-10T07:47:46.198560+0000","last_fullsized":"2024-09-10T07:47:46.198560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:03.590728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":35,"num_read_kb":58,"num_write":77,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":149793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":441646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1564672,"data_stored":1073390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972379,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":442228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234016,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":441668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1032713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":441763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1032313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":442250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":441984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":494847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":482711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":441736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T07:47:57.057 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T07:47:57.058 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T07:47:57.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T07:47:57.304 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:57.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 -- 172.21.15.73:0/3420184923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 msgr2=0x7efc1810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3420184923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 0x7efc1810a050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efc10009ca0 tx=0x7efc1002a8c0 comp rx=0 tx=0).stop 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 -- 172.21.15.73:0/3420184923 shutdown_connections 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3420184923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 0x7efc1810a050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3420184923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc18102e00 0x7efc18103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3420184923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc18101c00 0x7efc18102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 -- 172.21.15.73:0/3420184923 >> 172.21.15.73:0/3420184923 conn(0x7efc180fd390 msgr2=0x7efc180ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 -- 172.21.15.73:0/3420184923 shutdown_connections 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 -- 172.21.15.73:0/3420184923 wait complete. 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.800+0000 7efc1e50f640 1 Processor -- start 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1e50f640 1 -- start start 2024-09-10T07:47:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1e50f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc18101c00 0x7efc18198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1e50f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc18102e00 0x7efc18198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1e50f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 0x7efc1819f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1e50f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efc1810d980 con 0x7efc181037c0 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1e50f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efc1810d800 con 0x7efc18102e00 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1e50f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efc1810db00 con 0x7efc18101c00 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1caac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 0x7efc1819f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1caac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 0x7efc1819f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53130/0 (socket says 172.21.15.73:53130) 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1caac640 1 -- 172.21.15.73:0/3099235397 learned_addr learned my addr 172.21.15.73:0/3099235397 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc17fff640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc18101c00 0x7efc18198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1caac640 1 -- 172.21.15.73:0/3099235397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc18101c00 msgr2=0x7efc18198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1caac640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc18101c00 0x7efc18198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1caac640 1 -- 172.21.15.73:0/3099235397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc18102e00 msgr2=0x7efc18198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc177fe640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc18102e00 0x7efc18198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1caac640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc18102e00 0x7efc18198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.801+0000 7efc1caac640 1 -- 172.21.15.73:0/3099235397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1819fc60 con 0x7efc181037c0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.802+0000 7efc1caac640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 0x7efc1819f5f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc100098d0 tx=0x7efc1002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.802+0000 7efc157fa640 1 -- 172.21.15.73:0/3099235397 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1002fc30 con 0x7efc181037c0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.802+0000 7efc157fa640 1 -- 172.21.15.73:0/3099235397 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc10003e50 con 0x7efc181037c0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.802+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1819fef0 con 0x7efc181037c0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.802+0000 7efc157fa640 1 -- 172.21.15.73:0/3099235397 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc100305c0 con 0x7efc181037c0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.802+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc181a0420 con 0x7efc181037c0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.803+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc18109050 con 0x7efc181037c0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.804+0000 7efc157fa640 1 -- 172.21.15.73:0/3099235397 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efc10004b40 con 0x7efc181037c0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.805+0000 7efc157fa640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efc000a2c40 0x7efc000a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.805+0000 7efc17fff640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efc000a2c40 0x7efc000a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.805+0000 7efc157fa640 1 -- 172.21.15.73:0/3099235397 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7efc100f0680 con 0x7efc181037c0 2024-09-10T07:47:57.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.805+0000 7efc17fff640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efc000a2c40 0x7efc000a5100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efc18102c60 tx=0x7efc08008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:57.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:57.808+0000 7efc157fa640 1 -- 172.21.15.73:0/3099235397 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc100433d0 con 0x7efc181037c0 2024-09-10T07:47:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:57 smithi073 ceph-mon[30850]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:47:57.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:57 smithi073 ceph-mon[30850]: pgmap v289: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 6.1 KiB/s wr, 5 op/s; 55 B/s, 0 objects/s recovering 2024-09-10T07:47:58.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.040+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7efc1802d7c0 con 0x7efc181037c0 2024-09-10T07:47:58.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.044+0000 7efc157fa640 1 -- 172.21.15.73:0/3099235397 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7efc100bd570 con 0x7efc181037c0 2024-09-10T07:47:58.044 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-10T07:47:58.044 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCu+d9mSSx3AhAASFUMaTDnXQWh1dYoeYkz2g== 2024-09-10T07:47:58.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efc000a2c40 msgr2=0x7efc000a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:58.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efc000a2c40 0x7efc000a5100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efc18102c60 tx=0x7efc08008040 comp rx=0 tx=0).stop 2024-09-10T07:47:58.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 msgr2=0x7efc1819f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:58.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 0x7efc1819f5f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc100098d0 tx=0x7efc1002f840 comp rx=0 tx=0).stop 2024-09-10T07:47:58.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 shutdown_connections 2024-09-10T07:47:58.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7efc000a2c40 0x7efc000a5100 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:58.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc181037c0 0x7efc1819f5f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:58.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc18102e00 0x7efc18198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:58.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 --2- 172.21.15.73:0/3099235397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc18101c00 0x7efc18198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:58.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 >> 172.21.15.73:0/3099235397 conn(0x7efc180fd390 msgr2=0x7efc18106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:58.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 shutdown_connections 2024-09-10T07:47:58.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:58.047+0000 7efc1e50f640 1 -- 172.21.15.73:0/3099235397 wait complete. 2024-09-10T07:47:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:57 smithi102 ceph-mon[35514]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:47:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:57 smithi102 ceph-mon[35514]: pgmap v289: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 6.1 KiB/s wr, 5 op/s; 55 B/s, 0 objects/s recovering 2024-09-10T07:47:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:57 smithi159 ceph-mon[35522]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:47:58.209 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:57 smithi159 ceph-mon[35522]: pgmap v289: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 6.1 KiB/s wr, 5 op/s; 55 B/s, 0 objects/s recovering 2024-09-10T07:47:58.787 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:47:58.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T07:47:58.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T07:47:58.825 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T07:47:58.825 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T07:47:58.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T07:47:59.108 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:47:59.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:58 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3099235397' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T07:47:59.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:58 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3099235397' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T07:47:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:58 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3099235397' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T07:47:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:58 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3099235397' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T07:47:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:58 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3099235397' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T07:47:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:58 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3099235397' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T07:47:59.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.532+0000 7f2ad5035640 1 -- 172.21.15.73:0/3724383022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102570 msgr2=0x7f2ad01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:59.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.532+0000 7f2ad5035640 1 --2- 172.21.15.73:0/3724383022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102570 0x7f2ad01029b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009900 tx=0x7f2ab802a480 comp rx=0 tx=0).stop 2024-09-10T07:47:59.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.532+0000 7f2ad5035640 1 -- 172.21.15.73:0/3724383022 shutdown_connections 2024-09-10T07:47:59.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.532+0000 7f2ad5035640 1 --2- 172.21.15.73:0/3724383022 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0102ef0 0x7f2ad010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.532+0000 7f2ad5035640 1 --2- 172.21.15.73:0/3724383022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102570 0x7f2ad01029b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.532+0000 7f2ad5035640 1 --2- 172.21.15.73:0/3724383022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ad0100e20 0x7f2ad0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.532+0000 7f2ad5035640 1 -- 172.21.15.73:0/3724383022 >> 172.21.15.73:0/3724383022 conn(0x7f2ad00fc7d0 msgr2=0x7f2ad00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:59.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.532+0000 7f2ad5035640 1 -- 172.21.15.73:0/3724383022 shutdown_connections 2024-09-10T07:47:59.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.532+0000 7f2ad5035640 1 -- 172.21.15.73:0/3724383022 wait complete. 2024-09-10T07:47:59.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.533+0000 7f2ad5035640 1 Processor -- start 2024-09-10T07:47:59.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.533+0000 7f2ad5035640 1 -- start start 2024-09-10T07:47:59.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.533+0000 7f2ad5035640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ad0100e20 0x7f2ad0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:59.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.533+0000 7f2ad5035640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0102570 0x7f2ad0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:59.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.533+0000 7f2ad5035640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102ef0 0x7f2ad01a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:59.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.533+0000 7f2ad5035640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0110fa0 con 0x7f2ad0102ef0 2024-09-10T07:47:59.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.533+0000 7f2ad5035640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0110e20 con 0x7f2ad0102570 2024-09-10T07:47:59.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.533+0000 7f2ad5035640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0111120 con 0x7f2ad0100e20 2024-09-10T07:47:59.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.533+0000 7f2acf59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102ef0 0x7f2ad01a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2acf59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102ef0 0x7f2ad01a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53138/0 (socket says 172.21.15.73:53138) 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2acf59e640 1 -- 172.21.15.73:0/2205002440 learned_addr learned my addr 172.21.15.73:0/2205002440 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2aced9d640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ad0100e20 0x7f2ad0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2ace59c640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0102570 0x7f2ad0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2acf59e640 1 -- 172.21.15.73:0/2205002440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ad0100e20 msgr2=0x7f2ad0199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2acf59e640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ad0100e20 0x7f2ad0199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2acf59e640 1 -- 172.21.15.73:0/2205002440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0102570 msgr2=0x7f2ad0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2acf59e640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0102570 0x7f2ad0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2acf59e640 1 -- 172.21.15.73:0/2205002440 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad01a4910 con 0x7f2ad0102ef0 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2acf59e640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102ef0 0x7f2ad01a43d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009fd0 tx=0x7f2ac000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2ac7fff640 1 -- 172.21.15.73:0/2205002440 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0011830 con 0x7f2ad0102ef0 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad01a4ae0 con 0x7f2ad0102ef0 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2ac7fff640 1 -- 172.21.15.73:0/2205002440 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac0016070 con 0x7f2ad0102ef0 2024-09-10T07:47:59.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2ac7fff640 1 -- 172.21.15.73:0/2205002440 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000f2e0 con 0x7f2ad0102ef0 2024-09-10T07:47:59.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.534+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad01a4fd0 con 0x7f2ad0102ef0 2024-09-10T07:47:59.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.535+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad0101200 con 0x7f2ad0102ef0 2024-09-10T07:47:59.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.536+0000 7f2ac7fff640 1 -- 172.21.15.73:0/2205002440 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2ac00119d0 con 0x7f2ad0102ef0 2024-09-10T07:47:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.537+0000 7f2ac7fff640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2abc0a2c10 0x7f2abc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:47:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.537+0000 7f2aced9d640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2abc0a2c10 0x7f2abc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:47:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.537+0000 7f2ac7fff640 1 -- 172.21.15.73:0/2205002440 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f2ac00ce790 con 0x7f2ad0102ef0 2024-09-10T07:47:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.538+0000 7f2aced9d640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2abc0a2c10 0x7f2abc0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8005c40 tx=0x7f2ac800a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:47:59.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.541+0000 7f2ac7fff640 1 -- 172.21.15.73:0/2205002440 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ac009b680 con 0x7f2ad0102ef0 2024-09-10T07:47:59.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.755+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2ad0109090 con 0x7f2ad0102ef0 2024-09-10T07:47:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.759+0000 7f2ac7fff640 1 -- 172.21.15.73:0/2205002440 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263197 (secure 0 0 0) 0x7f2ac009af80 con 0x7f2ad0102ef0 2024-09-10T07:47:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:47:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2abc0a2c10 msgr2=0x7f2abc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2abc0a2c10 0x7f2abc0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8005c40 tx=0x7f2ac800a590 comp rx=0 tx=0).stop 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102ef0 msgr2=0x7f2ad01a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102ef0 0x7f2ad01a43d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009fd0 tx=0x7f2ac000b8e0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 shutdown_connections 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2abc0a2c10 0x7f2abc0a50d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ad0102ef0 0x7f2ad01a43d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0102570 0x7f2ad0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 --2- 172.21.15.73:0/2205002440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ad0100e20 0x7f2ad0199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.763+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 >> 172.21.15.73:0/2205002440 conn(0x7f2ad00fc7d0 msgr2=0x7f2ad00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.764+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 shutdown_connections 2024-09-10T07:47:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:47:59.764+0000 7f2ad5035640 1 -- 172.21.15.73:0/2205002440 wait complete. 2024-09-10T07:47:59.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:47:59 smithi073 ceph-mon[30850]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.1 KiB/s wr, 5 op/s; 48 B/s, 0 objects/s recovering 2024-09-10T07:48:00.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:47:59 smithi102 ceph-mon[35514]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.1 KiB/s wr, 5 op/s; 48 B/s, 0 objects/s recovering 2024-09-10T07:48:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:47:59 smithi159 ceph-mon[35522]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.1 KiB/s wr, 5 op/s; 48 B/s, 0 objects/s recovering 2024-09-10T07:48:00.361 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":662943870},{"type":"v1","addr":"172.21.15.73:6801","nonce":662943870}]},"active_addr":"172.21.15.73:6801/662943870","active_change":"2024-09-10T07:40:44.582118+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.73:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1430464896}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1757694921}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2752680748}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":643669867}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3362975109}]}]} 2024-09-10T07:48:00.367 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T07:48:00.367 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T07:48:00.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T07:48:00.613 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:00 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2205002440' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T07:48:01.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 -- 172.21.15.73:0/408096090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4100e20 msgr2=0x7feea4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:01.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 --2- 172.21.15.73:0/408096090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4100e20 0x7feea4101200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feea0009900 tx=0x7feea002a480 comp rx=0 tx=0).stop 2024-09-10T07:48:01.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 -- 172.21.15.73:0/408096090 shutdown_connections 2024-09-10T07:48:01.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 --2- 172.21.15.73:0/408096090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea4102ef0 0x7feea410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:01.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 --2- 172.21.15.73:0/408096090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea4102570 0x7feea41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 --2- 172.21.15.73:0/408096090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4100e20 0x7feea4101200 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 -- 172.21.15.73:0/408096090 >> 172.21.15.73:0/408096090 conn(0x7feea40fc7d0 msgr2=0x7feea40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 -- 172.21.15.73:0/408096090 shutdown_connections 2024-09-10T07:48:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 -- 172.21.15.73:0/408096090 wait complete. 2024-09-10T07:48:01.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 Processor -- start 2024-09-10T07:48:01.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.098+0000 7feeab4dc640 1 -- start start 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feeab4dc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea4100e20 0x7feea40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feeab4dc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4102570 0x7feea40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feeab4dc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea4102ef0 0x7feea40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feeab4dc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feea4110fc0 con 0x7feea4102570 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feeab4dc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feea4110e40 con 0x7feea4102ef0 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feeab4dc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feea4111140 con 0x7feea4100e20 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea8a77640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4102570 0x7feea40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea8a77640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4102570 0x7feea40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40922/0 (socket says 172.21.15.73:40922) 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea8a77640 1 -- 172.21.15.73:0/3754046427 learned_addr learned my addr 172.21.15.73:0/3754046427 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea9278640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea4100e20 0x7feea40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea8a77640 1 -- 172.21.15.73:0/3754046427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea4100e20 msgr2=0x7feea40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea8a77640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea4100e20 0x7feea40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea8a77640 1 -- 172.21.15.73:0/3754046427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea4102ef0 msgr2=0x7feea40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea8a77640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea4102ef0 0x7feea40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea8a77640 1 -- 172.21.15.73:0/3754046427 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea41a69b0 con 0x7feea4102570 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea9278640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea4100e20 0x7feea40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.099+0000 7feea8a77640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4102570 0x7feea40fd1c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b4a0 tx=0x7fee9400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.100+0000 7fee9a7fc640 1 -- 172.21.15.73:0/3754046427 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94014070 con 0x7feea4102570 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.100+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea41a6ca0 con 0x7feea4102570 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.100+0000 7fee9a7fc640 1 -- 172.21.15.73:0/3754046427 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee94010af0 con 0x7feea4102570 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.100+0000 7fee9a7fc640 1 -- 172.21.15.73:0/3754046427 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94017d10 con 0x7feea4102570 2024-09-10T07:48:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.100+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea41a7180 con 0x7feea4102570 2024-09-10T07:48:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.101+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea4101200 con 0x7feea4102570 2024-09-10T07:48:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.102+0000 7fee9a7fc640 1 -- 172.21.15.73:0/3754046427 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fee94017070 con 0x7feea4102570 2024-09-10T07:48:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.102+0000 7fee9a7fc640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee900a2c10 0x7fee900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.103+0000 7feea9278640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee900a2c10 0x7fee900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.103+0000 7fee9a7fc640 1 -- 172.21.15.73:0/3754046427 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fee940ce8f0 con 0x7feea4102570 2024-09-10T07:48:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.103+0000 7feea9278640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee900a2c10 0x7fee900a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feea0005ab0 tx=0x7feea0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.108+0000 7fee9a7fc640 1 -- 172.21.15.73:0/3754046427 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee9409b7e0 con 0x7feea4102570 2024-09-10T07:48:01.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:00 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2205002440' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T07:48:01.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:00 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2205002440' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T07:48:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.276+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feea40fe1b0 con 0x7feea4102570 2024-09-10T07:48:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.278+0000 7fee9a7fc640 1 -- 172.21.15.73:0/3754046427 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22859 (secure 0 0 0) 0x7feea40fe1b0 con 0x7feea4102570 2024-09-10T07:48:01.278 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:01.278 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":83,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:47:46.168838+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:47:28.792230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:47:30.666653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee900a2c10 msgr2=0x7fee900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee900a2c10 0x7fee900a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feea0005ab0 tx=0x7feea0005a20 comp rx=0 tx=0).stop 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4102570 msgr2=0x7feea40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4102570 0x7feea40fd1c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b4a0 tx=0x7fee9400b960 comp rx=0 tx=0).stop 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 shutdown_connections 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fee900a2c10 0x7fee900a50d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea4102ef0 0x7feea40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea4102570 0x7feea40fd1c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 --2- 172.21.15.73:0/3754046427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea4100e20 0x7feea40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 >> 172.21.15.73:0/3754046427 conn(0x7feea40fc7d0 msgr2=0x7feea406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 shutdown_connections 2024-09-10T07:48:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:01.280+0000 7feeab4dc640 1 -- 172.21.15.73:0/3754046427 wait complete. 2024-09-10T07:48:01.917 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T07:48:01.922 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T07:48:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:01 smithi102 ceph-mon[35514]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.7 KiB/s wr, 4 op/s; 48 B/s, 0 objects/s recovering 2024-09-10T07:48:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:01 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3754046427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:48:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:01 smithi159 ceph-mon[35522]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.7 KiB/s wr, 4 op/s; 48 B/s, 0 objects/s recovering 2024-09-10T07:48:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:01 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3754046427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:48:02.167 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:02.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:01 smithi073 ceph-mon[30850]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.7 KiB/s wr, 4 op/s; 48 B/s, 0 objects/s recovering 2024-09-10T07:48:02.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:01 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3754046427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:48:02.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.654+0000 7f391726b640 1 -- 172.21.15.73:0/3023567778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 msgr2=0x7f39101031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:02.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.654+0000 7f391726b640 1 --2- 172.21.15.73:0/3023567778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 0x7f39101031b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f390c009930 tx=0x7f390c02a420 comp rx=0 tx=0).stop 2024-09-10T07:48:02.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.654+0000 7f391726b640 1 -- 172.21.15.73:0/3023567778 shutdown_connections 2024-09-10T07:48:02.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.654+0000 7f391726b640 1 --2- 172.21.15.73:0/3023567778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3910108300 0x7f391010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:02.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.654+0000 7f391726b640 1 --2- 172.21.15.73:0/3023567778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3910103780 0x7f3910107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.654+0000 7f391726b640 1 --2- 172.21.15.73:0/3023567778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 0x7f39101031b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.654+0000 7f391726b640 1 -- 172.21.15.73:0/3023567778 >> 172.21.15.73:0/3023567778 conn(0x7f39100fc7d0 msgr2=0x7f39100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.654+0000 7f391726b640 1 -- 172.21.15.73:0/3023567778 shutdown_connections 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.654+0000 7f391726b640 1 -- 172.21.15.73:0/3023567778 wait complete. 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f391726b640 1 Processor -- start 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f391726b640 1 -- start start 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f391726b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 0x7f39101985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f391726b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3910103780 0x7f3910198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f391726b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3910108300 0x7f391019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f391726b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3910112110 con 0x7f3910102dd0 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f391726b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3910111f90 con 0x7f3910103780 2024-09-10T07:48:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f391726b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3910112290 con 0x7f3910108300 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f3915007640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 0x7f39101985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f3915007640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 0x7f39101985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40952/0 (socket says 172.21.15.73:40952) 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.655+0000 7f3915007640 1 -- 172.21.15.73:0/1733866986 learned_addr learned my addr 172.21.15.73:0/1733866986 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3915808640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3910108300 0x7f391019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3914806640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3910103780 0x7f3910198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3915007640 1 -- 172.21.15.73:0/1733866986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3910108300 msgr2=0x7f391019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3915007640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3910108300 0x7f391019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3915007640 1 -- 172.21.15.73:0/1733866986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3910103780 msgr2=0x7f3910198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3915007640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3910103780 0x7f3910198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3915007640 1 -- 172.21.15.73:0/1733866986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391019d580 con 0x7f3910102dd0 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3914806640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3910103780 0x7f3910198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3915808640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3910108300 0x7f391019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f3915007640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 0x7f39101985d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f390c009a50 tx=0x7f390c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f39067fc640 1 -- 172.21.15.73:0/1733866986 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c03f030 con 0x7f3910102dd0 2024-09-10T07:48:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f39067fc640 1 -- 172.21.15.73:0/1733866986 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f390c003ce0 con 0x7f3910102dd0 2024-09-10T07:48:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391019d810 con 0x7f3910102dd0 2024-09-10T07:48:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f39067fc640 1 -- 172.21.15.73:0/1733866986 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c035070 con 0x7f3910102dd0 2024-09-10T07:48:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.656+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3910100960 con 0x7f3910102dd0 2024-09-10T07:48:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.657+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391006a7b0 con 0x7f3910102dd0 2024-09-10T07:48:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.658+0000 7f39067fc640 1 -- 172.21.15.73:0/1733866986 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f390c042030 con 0x7f3910102dd0 2024-09-10T07:48:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.659+0000 7f39067fc640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f38fc0a2c90 0x7f38fc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.659+0000 7f3914806640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f38fc0a2c90 0x7f38fc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.659+0000 7f39067fc640 1 -- 172.21.15.73:0/1733866986 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f390c0efc00 con 0x7f3910102dd0 2024-09-10T07:48:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.659+0000 7f3914806640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f38fc0a2c90 0x7f38fc0a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f39100fed10 tx=0x7f3900005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.662+0000 7f39067fc640 1 -- 172.21.15.73:0/1733866986 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f390c0bc9e0 con 0x7f3910102dd0 2024-09-10T07:48:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.831+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39101031b0 con 0x7f3910102dd0 2024-09-10T07:48:02.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.833+0000 7f39067fc640 1 -- 172.21.15.73:0/1733866986 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22859 (secure 0 0 0) 0x7f39101031b0 con 0x7f3910102dd0 2024-09-10T07:48:02.832 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:02.832 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":83,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:47:46.168838+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:47:28.792230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:47:30.666653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:48:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f38fc0a2c90 msgr2=0x7f38fc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f38fc0a2c90 0x7f38fc0a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f39100fed10 tx=0x7f3900005d90 comp rx=0 tx=0).stop 2024-09-10T07:48:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 msgr2=0x7f39101985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 0x7f39101985d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f390c009a50 tx=0x7f390c004270 comp rx=0 tx=0).stop 2024-09-10T07:48:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 shutdown_connections 2024-09-10T07:48:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f38fc0a2c90 0x7f38fc0a5150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3910108300 0x7f391019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3910103780 0x7f3910198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 --2- 172.21.15.73:0/1733866986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3910102dd0 0x7f39101985d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 >> 172.21.15.73:0/1733866986 conn(0x7f39100fc7d0 msgr2=0x7f39101063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 shutdown_connections 2024-09-10T07:48:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:02.835+0000 7f391726b640 1 -- 172.21.15.73:0/1733866986 wait complete. 2024-09-10T07:48:03.513 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T07:48:03.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T07:48:03.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T07:48:03.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T07:48:03.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T07:48:03.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T07:48:03.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T07:48:03.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T07:48:03.517 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T07:48:03.517 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T07:48:03.518 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T07:48:03.518 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T07:48:03.736 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:03 smithi073 ceph-mon[30850]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-10T07:48:03.736 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:03 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1733866986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:48:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:03 smithi102 ceph-mon[35514]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-10T07:48:04.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:03 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1733866986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:48:04.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:03 smithi159 ceph-mon[35522]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-10T07:48:04.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:03 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1733866986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:48:04.177 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:04.181 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.977+0000 7fa04285a640 1 -- 172.21.15.73:0/1888104976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa03c106f20 msgr2=0x7fa03c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.977+0000 7fa04285a640 1 --2- 172.21.15.73:0/1888104976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa03c106f20 0x7fa03c10eaa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa034009ca0 tx=0x7fa03402a8c0 comp rx=0 tx=0).stop 2024-09-10T07:48:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.977+0000 7fa04285a640 1 -- 172.21.15.73:0/1888104976 shutdown_connections 2024-09-10T07:48:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.977+0000 7fa04285a640 1 --2- 172.21.15.73:0/1888104976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa03c106f20 0x7fa03c10eaa0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.977+0000 7fa04285a640 1 --2- 172.21.15.73:0/1888104976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa03c1027a0 0x7fa03c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.977+0000 7fa04285a640 1 --2- 172.21.15.73:0/1888104976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c101df0 0x7fa03c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.977+0000 7fa04285a640 1 -- 172.21.15.73:0/1888104976 >> 172.21.15.73:0/1888104976 conn(0x7fa03c0fd8b0 msgr2=0x7fa03c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.977+0000 7fa04285a640 1 -- 172.21.15.73:0/1888104976 shutdown_connections 2024-09-10T07:48:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.977+0000 7fa04285a640 1 -- 172.21.15.73:0/1888104976 wait complete. 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa04285a640 1 Processor -- start 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa04285a640 1 -- start start 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa04285a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa03c101df0 0x7fa03c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa04285a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa03c1027a0 0x7fa03c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa04285a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c106f20 0x7fa03c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa04285a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c111fa0 con 0x7fa03c1027a0 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa04285a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c111e20 con 0x7fa03c101df0 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa04285a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c112120 con 0x7fa03c106f20 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa03b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa03c1027a0 0x7fa03c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa03b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa03c1027a0 0x7fa03c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40962/0 (socket says 172.21.15.73:40962) 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa03b7fe640 1 -- 172.21.15.73:0/991513628 learned_addr learned my addr 172.21.15.73:0/991513628 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa03bfff640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa03c101df0 0x7fa03c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.978+0000 7fa040df7640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c106f20 0x7fa03c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa03b7fe640 1 -- 172.21.15.73:0/991513628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c106f20 msgr2=0x7fa03c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa03b7fe640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c106f20 0x7fa03c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa03b7fe640 1 -- 172.21.15.73:0/991513628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa03c101df0 msgr2=0x7fa03c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa03b7fe640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa03c101df0 0x7fa03c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa03b7fe640 1 -- 172.21.15.73:0/991513628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03c19d390 con 0x7fa03c1027a0 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa040df7640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c106f20 0x7fa03c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa03b7fe640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa03c1027a0 0x7fa03c198920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa03000b4a0 tx=0x7fa03000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa0397fa640 1 -- 172.21.15.73:0/991513628 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030015020 con 0x7fa03c1027a0 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03c19d680 con 0x7fa03c1027a0 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa0397fa640 1 -- 172.21.15.73:0/991513628 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa030011d10 con 0x7fa03c1027a0 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa0397fa640 1 -- 172.21.15.73:0/991513628 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03000f2e0 con 0x7fa03c1027a0 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.979+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03c1a4f60 con 0x7fa03c1027a0 2024-09-10T07:48:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.980+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa03c062940 con 0x7fa03c1027a0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.981+0000 7fa0397fa640 1 -- 172.21.15.73:0/991513628 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa030018020 con 0x7fa03c1027a0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.982+0000 7fa0397fa640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa0240a2c10 0x7fa0240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.982+0000 7fa03bfff640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa0240a2c10 0x7fa0240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.982+0000 7fa0397fa640 1 -- 172.21.15.73:0/991513628 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fa0300cef70 con 0x7fa03c1027a0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.982+0000 7fa0397fa640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] conn(0x7fa0240ac8c0 0x7fa0240aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.982+0000 7fa0397fa640 1 -- 172.21.15.73:0/991513628 --> [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa030004450 con 0x7fa0240ac8c0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.982+0000 7fa0397fa640 1 -- 172.21.15.73:0/991513628 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa0300cf3c0 con 0x7fa03c1027a0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.982+0000 7fa03bfff640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa0240a2c10 0x7fa0240a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00abe0 tx=0x7fa02c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.982+0000 7fa040df7640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] conn(0x7fa0240ac8c0 0x7fa0240aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.983+0000 7fa040df7640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] conn(0x7fa0240ac8c0 0x7fa0240aed60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.983+0000 7fa0397fa640 1 -- 172.21.15.73:0/991513628 <== osd.11 v2:172.21.15.159:6824/1651446392 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa030004450 con 0x7fa0240ac8c0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.997+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 --> [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa03c062d40 con 0x7fa0240ac8c0 2024-09-10T07:48:05.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.997+0000 7fa0397fa640 1 -- 172.21.15.73:0/991513628 <== osd.11 v2:172.21.15.159:6824/1651446392 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa03c062d40 con 0x7fa0240ac8c0 2024-09-10T07:48:05.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 >> [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] conn(0x7fa0240ac8c0 msgr2=0x7fa0240aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:05.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] conn(0x7fa0240ac8c0 0x7fa0240aed60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:05.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa0240a2c10 msgr2=0x7fa0240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa0240a2c10 0x7fa0240a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00abe0 tx=0x7fa02c00a2d0 comp rx=0 tx=0).stop 2024-09-10T07:48:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa03c1027a0 msgr2=0x7fa03c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 --2- 172.21.15.73:0/991513628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa03c1027a0 0x7fa03c198920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa03000b4a0 tx=0x7fa03000b8a0 comp rx=0 tx=0).stop 2024-09-10T07:48:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa040df7640 1 -- 172.21.15.73:0/991513628 reap_dead start 2024-09-10T07:48:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 shutdown_connections 2024-09-10T07:48:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 >> 172.21.15.73:0/991513628 conn(0x7fa03c0fd8b0 msgr2=0x7fa03c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 shutdown_connections 2024-09-10T07:48:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:04.998+0000 7fa04285a640 1 -- 172.21.15.73:0/991513628 wait complete. 2024-09-10T07:48:05.729 INFO:teuthology.orchestra.run.smithi073.stdout:322122547220 2024-09-10T07:48:05.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T07:48:05.971 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:05 smithi073 ceph-mon[30850]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-10T07:48:06.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:05 smithi102 ceph-mon[35514]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-10T07:48:06.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.137+0000 7fa5acc82640 1 -- 172.21.15.73:0/4267234569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8100a80 msgr2=0x7fa5a8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.137+0000 7fa5acc82640 1 --2- 172.21.15.73:0/4267234569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8100a80 0x7fa5a8100ee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009930 tx=0x7fa59c02a420 comp rx=0 tx=0).stop 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.137+0000 7fa5acc82640 1 -- 172.21.15.73:0/4267234569 shutdown_connections 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.137+0000 7fa5acc82640 1 --2- 172.21.15.73:0/4267234569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8101420 0x7fa5a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.137+0000 7fa5acc82640 1 --2- 172.21.15.73:0/4267234569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8100a80 0x7fa5a8100ee0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.137+0000 7fa5acc82640 1 --2- 172.21.15.73:0/4267234569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a8106a80 0x7fa5a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.137+0000 7fa5acc82640 1 -- 172.21.15.73:0/4267234569 >> 172.21.15.73:0/4267234569 conn(0x7fa5a80fc7a0 msgr2=0x7fa5a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.137+0000 7fa5acc82640 1 -- 172.21.15.73:0/4267234569 shutdown_connections 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.137+0000 7fa5acc82640 1 -- 172.21.15.73:0/4267234569 wait complete. 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5acc82640 1 Processor -- start 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5acc82640 1 -- start start 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5acc82640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a8100a80 0x7fa5a81973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5acc82640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8101420 0x7fa5a8197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5acc82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8106a80 0x7fa5a819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5acc82640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a8110ea0 con 0x7fa5a8106a80 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5acc82640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a8110d20 con 0x7fa5a8101420 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5acc82640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a8111020 con 0x7fa5a8100a80 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8106a80 0x7fa5a819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8106a80 0x7fa5a819bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40984/0 (socket says 172.21.15.73:40984) 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a6d9d640 1 -- 172.21.15.73:0/2842763449 learned_addr learned my addr 172.21.15.73:0/2842763449 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a659c640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a8100a80 0x7fa5a81973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a5d9b640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8101420 0x7fa5a8197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a6d9d640 1 -- 172.21.15.73:0/2842763449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a8100a80 msgr2=0x7fa5a81973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a6d9d640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a8100a80 0x7fa5a81973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a6d9d640 1 -- 172.21.15.73:0/2842763449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8101420 msgr2=0x7fa5a8197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:06.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a6d9d640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8101420 0x7fa5a8197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:06.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a6d9d640 1 -- 172.21.15.73:0/2842763449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a819c390 con 0x7fa5a8106a80 2024-09-10T07:48:06.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.138+0000 7fa5a5d9b640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8101420 0x7fa5a8197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:06.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.139+0000 7fa5a6d9d640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8106a80 0x7fa5a819bcb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000cad0 tx=0x7fa5a000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:06.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.139+0000 7fa5977fe640 1 -- 172.21.15.73:0/2842763449 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000ad60 con 0x7fa5a8106a80 2024-09-10T07:48:06.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.139+0000 7fa5977fe640 1 -- 172.21.15.73:0/2842763449 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5a0005020 con 0x7fa5a8106a80 2024-09-10T07:48:06.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.139+0000 7fa5977fe640 1 -- 172.21.15.73:0/2842763449 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000f6b0 con 0x7fa5a8106a80 2024-09-10T07:48:06.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.139+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a819c680 con 0x7fa5a8106a80 2024-09-10T07:48:06.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.139+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a81a3f60 con 0x7fa5a8106a80 2024-09-10T07:48:06.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.140+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5a8062980 con 0x7fa5a8106a80 2024-09-10T07:48:06.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.141+0000 7fa5977fe640 1 -- 172.21.15.73:0/2842763449 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa5a0005560 con 0x7fa5a8106a80 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.141+0000 7fa5977fe640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5900a2c10 0x7fa5900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.142+0000 7fa5a659c640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5900a2c10 0x7fa5900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.142+0000 7fa5977fe640 1 -- 172.21.15.73:0/2842763449 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fa5a00cf610 con 0x7fa5a8106a80 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.142+0000 7fa5977fe640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] conn(0x7fa5900ac8c0 0x7fa5900aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.142+0000 7fa5977fe640 1 -- 172.21.15.73:0/2842763449 --> [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5900af430 con 0x7fa5900ac8c0 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.142+0000 7fa5977fe640 1 -- 172.21.15.73:0/2842763449 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa5a00cfa60 con 0x7fa5a8106a80 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.142+0000 7fa5a659c640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5900a2c10 0x7fa5900a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa598009990 tx=0x7fa598009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.142+0000 7fa5a5d9b640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] conn(0x7fa5900ac8c0 0x7fa5900aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.143+0000 7fa5a5d9b640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] conn(0x7fa5900ac8c0 0x7fa5900aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.143+0000 7fa5977fe640 1 -- 172.21.15.73:0/2842763449 <== osd.5 v2:172.21.15.159:6808/877454458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5900af430 con 0x7fa5900ac8c0 2024-09-10T07:48:06.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.157+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 --> [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa5a8062e00 con 0x7fa5900ac8c0 2024-09-10T07:48:06.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.157+0000 7fa5977fe640 1 -- 172.21.15.73:0/2842763449 <== osd.5 v2:172.21.15.159:6808/877454458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa5a8062e00 con 0x7fa5900ac8c0 2024-09-10T07:48:06.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.157+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 >> [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] conn(0x7fa5900ac8c0 msgr2=0x7fa5900aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:06.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.157+0000 7fa5acc82640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] conn(0x7fa5900ac8c0 0x7fa5900aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:06.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.157+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5900a2c10 msgr2=0x7fa5900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:06.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.157+0000 7fa5acc82640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5900a2c10 0x7fa5900a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa598009990 tx=0x7fa598009110 comp rx=0 tx=0).stop 2024-09-10T07:48:06.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.157+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8106a80 msgr2=0x7fa5a819bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:06.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.158+0000 7fa5acc82640 1 --2- 172.21.15.73:0/2842763449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a8106a80 0x7fa5a819bcb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000cad0 tx=0x7fa5a000ced0 comp rx=0 tx=0).stop 2024-09-10T07:48:06.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.158+0000 7fa5a6d9d640 1 -- 172.21.15.73:0/2842763449 reap_dead start 2024-09-10T07:48:06.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.158+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 shutdown_connections 2024-09-10T07:48:06.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.158+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 >> 172.21.15.73:0/2842763449 conn(0x7fa5a80fc7a0 msgr2=0x7fa5a80fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:06.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.158+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 shutdown_connections 2024-09-10T07:48:06.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:06.158+0000 7fa5acc82640 1 -- 172.21.15.73:0/2842763449 wait complete. 2024-09-10T07:48:06.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:05 smithi159 ceph-mon[35522]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-10T07:48:06.915 INFO:teuthology.orchestra.run.smithi073.stdout:154618822706 2024-09-10T07:48:06.915 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T07:48:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.102+0000 7fc243724640 1 -- 172.21.15.73:0/742389513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc23c102570 msgr2=0x7fc23c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.102+0000 7fc243724640 1 --2- 172.21.15.73:0/742389513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc23c102570 0x7fc23c1029b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009900 tx=0x7fc22c02a480 comp rx=0 tx=0).stop 2024-09-10T07:48:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.102+0000 7fc243724640 1 -- 172.21.15.73:0/742389513 shutdown_connections 2024-09-10T07:48:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.102+0000 7fc243724640 1 --2- 172.21.15.73:0/742389513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c102ef0 0x7fc23c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.102+0000 7fc243724640 1 --2- 172.21.15.73:0/742389513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc23c102570 0x7fc23c1029b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.102+0000 7fc243724640 1 --2- 172.21.15.73:0/742389513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc23c100e20 0x7fc23c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.102+0000 7fc243724640 1 -- 172.21.15.73:0/742389513 >> 172.21.15.73:0/742389513 conn(0x7fc23c0fc7d0 msgr2=0x7fc23c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.102+0000 7fc243724640 1 -- 172.21.15.73:0/742389513 shutdown_connections 2024-09-10T07:48:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.102+0000 7fc243724640 1 -- 172.21.15.73:0/742389513 wait complete. 2024-09-10T07:48:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc243724640 1 Processor -- start 2024-09-10T07:48:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc243724640 1 -- start start 2024-09-10T07:48:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc243724640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c100e20 0x7fc23c1962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc243724640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc23c102570 0x7fc23c196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc243724640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc23c102ef0 0x7fc23c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc243724640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10fe80 con 0x7fc23c102ef0 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc243724640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10fd00 con 0x7fc23c102570 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc243724640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c110000 con 0x7fc23c100e20 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc2414c0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c100e20 0x7fc23c1962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc241cc1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc23c102ef0 0x7fc23c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc2414c0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c100e20 0x7fc23c1962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.73:51752/0 (socket says 172.21.15.73:51752) 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.103+0000 7fc2414c0640 1 -- 172.21.15.73:0/3089104900 learned_addr learned my addr 172.21.15.73:0/3089104900 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc240cbf640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc23c102570 0x7fc23c196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc2414c0640 1 -- 172.21.15.73:0/3089104900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc23c102570 msgr2=0x7fc23c196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc2414c0640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc23c102570 0x7fc23c196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc2414c0640 1 -- 172.21.15.73:0/3089104900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc23c102ef0 msgr2=0x7fc23c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc2414c0640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc23c102ef0 0x7fc23c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc2414c0640 1 -- 172.21.15.73:0/3089104900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c19b290 con 0x7fc23c100e20 2024-09-10T07:48:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc240cbf640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc23c102570 0x7fc23c196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:48:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc241cc1640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc23c102ef0 0x7fc23c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:48:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc2414c0640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c100e20 0x7fc23c1962e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc23800d950 tx=0x7fc23800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.104+0000 7fc2327fc640 1 -- 172.21.15.73:0/3089104900 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238017070 con 0x7fc23c100e20 2024-09-10T07:48:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.105+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c19b580 con 0x7fc23c100e20 2024-09-10T07:48:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.105+0000 7fc2327fc640 1 -- 172.21.15.73:0/3089104900 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc238009c30 con 0x7fc23c100e20 2024-09-10T07:48:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.105+0000 7fc2327fc640 1 -- 172.21.15.73:0/3089104900 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23800f6b0 con 0x7fc23c100e20 2024-09-10T07:48:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.105+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc23c19b9d0 con 0x7fc23c100e20 2024-09-10T07:48:07.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.105+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc23c062980 con 0x7fc23c100e20 2024-09-10T07:48:07.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.107+0000 7fc2327fc640 1 -- 172.21.15.73:0/3089104900 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc2380109d0 con 0x7fc23c100e20 2024-09-10T07:48:07.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.108+0000 7fc2327fc640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc2280a4e20 0x7fc2280a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:07.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.108+0000 7fc240cbf640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc2280a4e20 0x7fc2280a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:07.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.108+0000 7fc2327fc640 1 -- 172.21.15.73:0/3089104900 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fc2380cf160 con 0x7fc23c100e20 2024-09-10T07:48:07.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.108+0000 7fc2327fc640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] conn(0x7fc2280aead0 0x7fc2280b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:07.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.108+0000 7fc2327fc640 1 -- 172.21.15.73:0/3089104900 --> [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2280b1640 con 0x7fc2280aead0 2024-09-10T07:48:07.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.108+0000 7fc2327fc640 1 -- 172.21.15.73:0/3089104900 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc2380cf510 con 0x7fc23c100e20 2024-09-10T07:48:07.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.108+0000 7fc240cbf640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc2280a4e20 0x7fc2280a72e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009230 tx=0x7fc22c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:07.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.108+0000 7fc241cc1640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] conn(0x7fc2280aead0 0x7fc2280b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:07.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.109+0000 7fc241cc1640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] conn(0x7fc2280aead0 0x7fc2280b0f70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:07.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.109+0000 7fc2327fc640 1 -- 172.21.15.73:0/3089104900 <== osd.4 v2:172.21.15.102:6808/1176212807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2280b1640 con 0x7fc2280aead0 2024-09-10T07:48:07.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.129+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 --> [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc23c062e00 con 0x7fc2280aead0 2024-09-10T07:48:07.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc2327fc640 1 -- 172.21.15.73:0/3089104900 <== osd.4 v2:172.21.15.102:6808/1176212807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc23c062e00 con 0x7fc2280aead0 2024-09-10T07:48:07.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 >> [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] conn(0x7fc2280aead0 msgr2=0x7fc2280b0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:07.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc243724640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] conn(0x7fc2280aead0 0x7fc2280b0f70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:07.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc2280a4e20 msgr2=0x7fc2280a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:07.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc243724640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fc2280a4e20 0x7fc2280a72e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009230 tx=0x7fc22c0058d0 comp rx=0 tx=0).stop 2024-09-10T07:48:07.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c100e20 msgr2=0x7fc23c1962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:07.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc243724640 1 --2- 172.21.15.73:0/3089104900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c100e20 0x7fc23c1962e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc23800d950 tx=0x7fc23800de10 comp rx=0 tx=0).stop 2024-09-10T07:48:07.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc241cc1640 1 -- 172.21.15.73:0/3089104900 reap_dead start 2024-09-10T07:48:07.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 shutdown_connections 2024-09-10T07:48:07.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.130+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 >> 172.21.15.73:0/3089104900 conn(0x7fc23c0fc7d0 msgr2=0x7fc23c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:07.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.131+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 shutdown_connections 2024-09-10T07:48:07.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:07.131+0000 7fc243724640 1 -- 172.21.15.73:0/3089104900 wait complete. 2024-09-10T07:48:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:07.792 INFO:teuthology.orchestra.run.smithi073.stdout:133143986231 2024-09-10T07:48:07.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T07:48:07.992 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:07 smithi073 ceph-mon[30850]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-10T07:48:08.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:07 smithi102 ceph-mon[35514]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-10T07:48:08.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:07 smithi159 ceph-mon[35522]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-10T07:48:08.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.814+0000 7fd344904640 1 -- 172.21.15.73:0/3284510652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd340103660 msgr2=0x7fd34010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.814+0000 7fd344904640 1 --2- 172.21.15.73:0/3284510652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd340103660 0x7fd34010bb50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd328009900 tx=0x7fd32802a480 comp rx=0 tx=0).stop 2024-09-10T07:48:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.814+0000 7fd344904640 1 -- 172.21.15.73:0/3284510652 shutdown_connections 2024-09-10T07:48:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.814+0000 7fd344904640 1 --2- 172.21.15.73:0/3284510652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd34010c170 0x7fd34010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.814+0000 7fd344904640 1 --2- 172.21.15.73:0/3284510652 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd340103660 0x7fd34010bb50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.814+0000 7fd344904640 1 --2- 172.21.15.73:0/3284510652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd340102d40 0x7fd340103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.814+0000 7fd344904640 1 -- 172.21.15.73:0/3284510652 >> 172.21.15.73:0/3284510652 conn(0x7fd3400fc7a0 msgr2=0x7fd3400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.814+0000 7fd344904640 1 -- 172.21.15.73:0/3284510652 shutdown_connections 2024-09-10T07:48:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.814+0000 7fd344904640 1 -- 172.21.15.73:0/3284510652 wait complete. 2024-09-10T07:48:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd344904640 1 Processor -- start 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd344904640 1 -- start start 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd344904640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340102d40 0x7fd340198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd344904640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd340103660 0x7fd340198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd344904640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd34010c170 0x7fd34019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd344904640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd340111fb0 con 0x7fd340103660 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd344904640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd340111e30 con 0x7fd340102d40 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd344904640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd340112130 con 0x7fd34010c170 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd33dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd340103660 0x7fd340198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd33dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd340103660 0x7fd340198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41030/0 (socket says 172.21.15.73:41030) 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd33dd9b640 1 -- 172.21.15.73:0/4131062482 learned_addr learned my addr 172.21.15.73:0/4131062482 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.815+0000 7fd33ed9d640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd34010c170 0x7fd34019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:08.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd33e59c640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340102d40 0x7fd340198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:08.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd33dd9b640 1 -- 172.21.15.73:0/4131062482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd34010c170 msgr2=0x7fd34019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:08.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd33dd9b640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd34010c170 0x7fd34019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:08.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd33dd9b640 1 -- 172.21.15.73:0/4131062482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340102d40 msgr2=0x7fd340198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:08.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd33dd9b640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340102d40 0x7fd340198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:08.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd33dd9b640 1 -- 172.21.15.73:0/4131062482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34019d400 con 0x7fd340103660 2024-09-10T07:48:08.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd33dd9b640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd340103660 0x7fd340198990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd328005ab0 tx=0x7fd3280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:08.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd3377fe640 1 -- 172.21.15.73:0/4131062482 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32803f030 con 0x7fd340103660 2024-09-10T07:48:08.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd3377fe640 1 -- 172.21.15.73:0/4131062482 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd328003ce0 con 0x7fd340103660 2024-09-10T07:48:08.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34019d690 con 0x7fd340103660 2024-09-10T07:48:08.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd3377fe640 1 -- 172.21.15.73:0/4131062482 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328035070 con 0x7fd340103660 2024-09-10T07:48:08.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.816+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3401a4fd0 con 0x7fd340103660 2024-09-10T07:48:08.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.817+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd340062980 con 0x7fd340103660 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.818+0000 7fd3377fe640 1 -- 172.21.15.73:0/4131062482 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd328042030 con 0x7fd340103660 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.819+0000 7fd3377fe640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd32c0a2c10 0x7fd32c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.819+0000 7fd33e59c640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd32c0a2c10 0x7fd32c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.819+0000 7fd3377fe640 1 -- 172.21.15.73:0/4131062482 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fd3280efcb0 con 0x7fd340103660 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.819+0000 7fd3377fe640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] conn(0x7fd32c0ac8c0 0x7fd32c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.819+0000 7fd3377fe640 1 -- 172.21.15.73:0/4131062482 --> [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd328001d30 con 0x7fd32c0ac8c0 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.819+0000 7fd3377fe640 1 -- 172.21.15.73:0/4131062482 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fd3280f0100 con 0x7fd340103660 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.820+0000 7fd33e59c640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd32c0a2c10 0x7fd32c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd330009890 tx=0x7fd330008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.820+0000 7fd33ed9d640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] conn(0x7fd32c0ac8c0 0x7fd32c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.820+0000 7fd33ed9d640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] conn(0x7fd32c0ac8c0 0x7fd32c0aed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.820+0000 7fd3377fe640 1 -- 172.21.15.73:0/4131062482 <== osd.6 v2:172.21.15.73:6818/3759904745 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd328001d30 con 0x7fd32c0ac8c0 2024-09-10T07:48:08.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 --> [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd340062e00 con 0x7fd32c0ac8c0 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd3377fe640 1 -- 172.21.15.73:0/4131062482 <== osd.6 v2:172.21.15.73:6818/3759904745 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd340062e00 con 0x7fd32c0ac8c0 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] conn(0x7fd32c0ac8c0 msgr2=0x7fd32c0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] conn(0x7fd32c0ac8c0 0x7fd32c0aed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd32c0a2c10 msgr2=0x7fd32c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd32c0a2c10 0x7fd32c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd330009890 tx=0x7fd330008040 comp rx=0 tx=0).stop 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd340103660 msgr2=0x7fd340198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 --2- 172.21.15.73:0/4131062482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd340103660 0x7fd340198990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd328005ab0 tx=0x7fd3280042f0 comp rx=0 tx=0).stop 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd33ed9d640 1 -- 172.21.15.73:0/4131062482 reap_dead start 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 shutdown_connections 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 >> 172.21.15.73:0/4131062482 conn(0x7fd3400fc7a0 msgr2=0x7fd3400fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 shutdown_connections 2024-09-10T07:48:08.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:08.834+0000 7fd344904640 1 -- 172.21.15.73:0/4131062482 wait complete. 2024-09-10T07:48:09.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.258+0000 7f651089d640 1 -- 172.21.15.73:0/94543700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650c101430 msgr2=0x7f650c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.258+0000 7f651089d640 1 --2- 172.21.15.73:0/94543700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650c101430 0x7f650c10d960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6504009cd0 tx=0x7f650402a8e0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.258+0000 7f651089d640 1 -- 172.21.15.73:0/94543700 shutdown_connections 2024-09-10T07:48:09.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.258+0000 7f651089d640 1 --2- 172.21.15.73:0/94543700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650c101430 0x7f650c10d960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.258+0000 7f651089d640 1 --2- 172.21.15.73:0/94543700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f650c100a90 0x7f650c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.258+0000 7f651089d640 1 --2- 172.21.15.73:0/94543700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f650c106a90 0x7f650c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.258+0000 7f651089d640 1 -- 172.21.15.73:0/94543700 >> 172.21.15.73:0/94543700 conn(0x7f650c0fc7d0 msgr2=0x7f650c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:09.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.258+0000 7f651089d640 1 -- 172.21.15.73:0/94543700 shutdown_connections 2024-09-10T07:48:09.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.258+0000 7f651089d640 1 -- 172.21.15.73:0/94543700 wait complete. 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f651089d640 1 Processor -- start 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f651089d640 1 -- start start 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f651089d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f650c100a90 0x7f650c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f651089d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650c101430 0x7f650c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f651089d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f650c106a90 0x7f650c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f651089d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f650c110e90 con 0x7f650c101430 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f651089d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f650c110d10 con 0x7f650c106a90 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f651089d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f650c111010 con 0x7f650c100a90 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f6503fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650c101430 0x7f650c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f6503fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650c101430 0x7f650c19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41042/0 (socket says 172.21.15.73:41042) 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f6503fff640 1 -- 172.21.15.73:0/2934275778 learned_addr learned my addr 172.21.15.73:0/2934275778 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f650a59c640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f650c100a90 0x7f650c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f650ad9d640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f650c106a90 0x7f650c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f6503fff640 1 -- 172.21.15.73:0/2934275778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f650c100a90 msgr2=0x7f650c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f6503fff640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f650c100a90 0x7f650c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f6503fff640 1 -- 172.21.15.73:0/2934275778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f650c106a90 msgr2=0x7f650c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f6503fff640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f650c106a90 0x7f650c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f6503fff640 1 -- 172.21.15.73:0/2934275778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c19f640 con 0x7f650c101430 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.259+0000 7f6503fff640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650c101430 0x7f650c19abd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f64f400d950 tx=0x7f64f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.260+0000 7f65037fe640 1 -- 172.21.15.73:0/2934275778 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f4017070 con 0x7f650c101430 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.260+0000 7f65037fe640 1 -- 172.21.15.73:0/2934275778 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64f4009c30 con 0x7f650c101430 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.260+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650c19f930 con 0x7f650c101430 2024-09-10T07:48:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.260+0000 7f65037fe640 1 -- 172.21.15.73:0/2934275778 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f400f6b0 con 0x7f650c101430 2024-09-10T07:48:09.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.260+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f650c1a7210 con 0x7f650c101430 2024-09-10T07:48:09.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.261+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f650c06b230 con 0x7f650c101430 2024-09-10T07:48:09.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.262+0000 7f65037fe640 1 -- 172.21.15.73:0/2934275778 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f64f40109d0 con 0x7f650c101430 2024-09-10T07:48:09.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.262+0000 7f65037fe640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f64f80a2c10 0x7f64f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.262+0000 7f650a59c640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f64f80a2c10 0x7f64f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.263+0000 7f65037fe640 1 -- 172.21.15.73:0/2934275778 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f64f40cf120 con 0x7f650c101430 2024-09-10T07:48:09.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.263+0000 7f65037fe640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] conn(0x7f64f80ac8c0 0x7f64f80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.263+0000 7f65037fe640 1 -- 172.21.15.73:0/2934275778 --> [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64f80af430 con 0x7f64f80ac8c0 2024-09-10T07:48:09.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.263+0000 7f65037fe640 1 -- 172.21.15.73:0/2934275778 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f64f40cf570 con 0x7f650c101430 2024-09-10T07:48:09.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.263+0000 7f650ad9d640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] conn(0x7f64f80ac8c0 0x7f64f80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.263+0000 7f650a59c640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f64f80a2c10 0x7f64f80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f64fc005fd0 tx=0x7f64fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:09.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.263+0000 7f650ad9d640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] conn(0x7f64f80ac8c0 0x7f64f80aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:09.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.264+0000 7f65037fe640 1 -- 172.21.15.73:0/2934275778 <== osd.9 v2:172.21.15.73:6826/3756582500 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64f80af430 con 0x7f64f80ac8c0 2024-09-10T07:48:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.277+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 --> [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f650c1021d0 con 0x7f64f80ac8c0 2024-09-10T07:48:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f65037fe640 1 -- 172.21.15.73:0/2934275778 <== osd.9 v2:172.21.15.73:6826/3756582500 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f650c1021d0 con 0x7f64f80ac8c0 2024-09-10T07:48:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] conn(0x7f64f80ac8c0 msgr2=0x7f64f80aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] conn(0x7f64f80ac8c0 0x7f64f80aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f64f80a2c10 msgr2=0x7f64f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f64f80a2c10 0x7f64f80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f64fc005fd0 tx=0x7f64fc00b390 comp rx=0 tx=0).stop 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650c101430 msgr2=0x7f650c19abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 --2- 172.21.15.73:0/2934275778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650c101430 0x7f650c19abd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f64f400d950 tx=0x7f64f400de10 comp rx=0 tx=0).stop 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f650ad9d640 1 -- 172.21.15.73:0/2934275778 reap_dead start 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 shutdown_connections 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 >> 172.21.15.73:0/2934275778 conn(0x7f650c0fc7d0 msgr2=0x7f650c06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 shutdown_connections 2024-09-10T07:48:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.278+0000 7f651089d640 1 -- 172.21.15.73:0/2934275778 wait complete. 2024-09-10T07:48:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.879+0000 7f913eb0e640 1 -- 172.21.15.73:0/370123406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9138106f10 msgr2=0x7f913810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.879+0000 7f913eb0e640 1 --2- 172.21.15.73:0/370123406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9138106f10 0x7f913810ea90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9130009ca0 tx=0x7f913002a8c0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.879+0000 7f913eb0e640 1 -- 172.21.15.73:0/370123406 shutdown_connections 2024-09-10T07:48:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.879+0000 7f913eb0e640 1 --2- 172.21.15.73:0/370123406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9138106f10 0x7f913810ea90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.879+0000 7f913eb0e640 1 --2- 172.21.15.73:0/370123406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9138102790 0x7f91381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.879+0000 7f913eb0e640 1 --2- 172.21.15.73:0/370123406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9138101de0 0x7f91381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.879+0000 7f913eb0e640 1 -- 172.21.15.73:0/370123406 >> 172.21.15.73:0/370123406 conn(0x7f91380fd8c0 msgr2=0x7f91380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.879+0000 7f913eb0e640 1 -- 172.21.15.73:0/370123406 shutdown_connections 2024-09-10T07:48:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.879+0000 7f913eb0e640 1 -- 172.21.15.73:0/370123406 wait complete. 2024-09-10T07:48:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913eb0e640 1 Processor -- start 2024-09-10T07:48:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913eb0e640 1 -- start start 2024-09-10T07:48:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913eb0e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9138101de0 0x7f91381983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913eb0e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9138102790 0x7f91381988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913eb0e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9138106f10 0x7f913819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913eb0e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9138111f70 con 0x7f9138102790 2024-09-10T07:48:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913eb0e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9138111df0 con 0x7f9138101de0 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913eb0e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f91381120f0 con 0x7f9138106f10 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f9137fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9138102790 0x7f91381988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f9137fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9138102790 0x7f91381988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41064/0 (socket says 172.21.15.73:41064) 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f9137fff640 1 -- 172.21.15.73:0/2000042683 learned_addr learned my addr 172.21.15.73:0/2000042683 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913c8aa640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9138101de0 0x7f91381983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f913d0ab640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9138106f10 0x7f913819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f9137fff640 1 -- 172.21.15.73:0/2000042683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9138106f10 msgr2=0x7f913819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f9137fff640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9138106f10 0x7f913819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f9137fff640 1 -- 172.21.15.73:0/2000042683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9138101de0 msgr2=0x7f91381983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f9137fff640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9138101de0 0x7f91381983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.880+0000 7f9137fff640 1 -- 172.21.15.73:0/2000042683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913819d350 con 0x7f9138102790 2024-09-10T07:48:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.881+0000 7f9137fff640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9138102790 0x7f91381988e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f912400e9f0 tx=0x7f912400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.881+0000 7f9135ffb640 1 -- 172.21.15.73:0/2000042683 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912400cd80 con 0x7f9138102790 2024-09-10T07:48:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.881+0000 7f9135ffb640 1 -- 172.21.15.73:0/2000042683 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9124010910 con 0x7f9138102790 2024-09-10T07:48:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.881+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913819d640 con 0x7f9138102790 2024-09-10T07:48:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.881+0000 7f9135ffb640 1 -- 172.21.15.73:0/2000042683 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124018990 con 0x7f9138102790 2024-09-10T07:48:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.881+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91381a4f20 con 0x7f9138102790 2024-09-10T07:48:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.882+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9138062980 con 0x7f9138102790 2024-09-10T07:48:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.883+0000 7f9135ffb640 1 -- 172.21.15.73:0/2000042683 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9124010ac0 con 0x7f9138102790 2024-09-10T07:48:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.884+0000 7f9135ffb640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f91280a2c90 0x7f91280a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.884+0000 7f913c8aa640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f91280a2c90 0x7f91280a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.884+0000 7f9135ffb640 1 -- 172.21.15.73:0/2000042683 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f91240cfb10 con 0x7f9138102790 2024-09-10T07:48:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.884+0000 7f9135ffb640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] conn(0x7f91280ac940 0x7f91280aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.884+0000 7f9135ffb640 1 -- 172.21.15.73:0/2000042683 --> [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91280af4b0 con 0x7f91280ac940 2024-09-10T07:48:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.884+0000 7f9135ffb640 1 -- 172.21.15.73:0/2000042683 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f91240cff60 con 0x7f9138102790 2024-09-10T07:48:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.884+0000 7f913d0ab640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] conn(0x7f91280ac940 0x7f91280aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.884+0000 7f913c8aa640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f91280a2c90 0x7f91280a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f912c009bd0 tx=0x7f912c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.885+0000 7f913d0ab640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] conn(0x7f91280ac940 0x7f91280aede0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.885+0000 7f9135ffb640 1 -- 172.21.15.73:0/2000042683 <== osd.3 v2:172.21.15.73:6810/2078486916 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91280af4b0 con 0x7f91280ac940 2024-09-10T07:48:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.898+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 --> [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9138062d80 con 0x7f91280ac940 2024-09-10T07:48:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f9135ffb640 1 -- 172.21.15.73:0/2000042683 <== osd.3 v2:172.21.15.73:6810/2078486916 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9138062d80 con 0x7f91280ac940 2024-09-10T07:48:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] conn(0x7f91280ac940 msgr2=0x7f91280aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] conn(0x7f91280ac940 0x7f91280aede0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f91280a2c90 msgr2=0x7f91280a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f91280a2c90 0x7f91280a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f912c009bd0 tx=0x7f912c005f90 comp rx=0 tx=0).stop 2024-09-10T07:48:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9138102790 msgr2=0x7f91381988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 --2- 172.21.15.73:0/2000042683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9138102790 0x7f91381988e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f912400e9f0 tx=0x7f912400eeb0 comp rx=0 tx=0).stop 2024-09-10T07:48:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913d0ab640 1 -- 172.21.15.73:0/2000042683 reap_dead start 2024-09-10T07:48:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 shutdown_connections 2024-09-10T07:48:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 >> 172.21.15.73:0/2000042683 conn(0x7f91380fd8c0 msgr2=0x7f91380fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:09.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 shutdown_connections 2024-09-10T07:48:09.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:09.899+0000 7f913eb0e640 1 -- 172.21.15.73:0/2000042683 wait complete. 2024-09-10T07:48:10.003 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:09 smithi073 ceph-mon[30850]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-10T07:48:10.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.080+0000 7fa5c8698640 1 -- 172.21.15.73:0/3172890805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01036e0 msgr2=0x7fa5c0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:10.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.080+0000 7fa5c8698640 1 --2- 172.21.15.73:0/3172890805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01036e0 0x7fa5c0107b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009930 tx=0x7fa5b002a420 comp rx=0 tx=0).stop 2024-09-10T07:48:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.080+0000 7fa5c8698640 1 -- 172.21.15.73:0/3172890805 shutdown_connections 2024-09-10T07:48:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.080+0000 7fa5c8698640 1 --2- 172.21.15.73:0/3172890805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c01082a0 0x7fa5c010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.080+0000 7fa5c8698640 1 --2- 172.21.15.73:0/3172890805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01036e0 0x7fa5c0107b90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.080+0000 7fa5c8698640 1 --2- 172.21.15.73:0/3172890805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c0102d30 0x7fa5c0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.080+0000 7fa5c8698640 1 -- 172.21.15.73:0/3172890805 >> 172.21.15.73:0/3172890805 conn(0x7fa5c00fc7d0 msgr2=0x7fa5c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.080+0000 7fa5c8698640 1 -- 172.21.15.73:0/3172890805 shutdown_connections 2024-09-10T07:48:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.080+0000 7fa5c8698640 1 -- 172.21.15.73:0/3172890805 wait complete. 2024-09-10T07:48:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c8698640 1 Processor -- start 2024-09-10T07:48:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c8698640 1 -- start start 2024-09-10T07:48:10.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c8698640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c0102d30 0x7fa5c0198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:10.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c8698640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01036e0 0x7fa5c0198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:10.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c8698640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c01082a0 0x7fa5c019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:10.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c8698640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c01120a0 con 0x7fa5c01036e0 2024-09-10T07:48:10.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c8698640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c0111f20 con 0x7fa5c01082a0 2024-09-10T07:48:10.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c8698640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c0112220 con 0x7fa5c0102d30 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c5c33640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01036e0 0x7fa5c0198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c5c33640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01036e0 0x7fa5c0198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43862/0 (socket says 172.21.15.73:43862) 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c5c33640 1 -- 172.21.15.73:0/3629300629 learned_addr learned my addr 172.21.15.73:0/3629300629 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c6434640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c0102d30 0x7fa5c0198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c6c35640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c01082a0 0x7fa5c019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c5c33640 1 -- 172.21.15.73:0/3629300629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c0102d30 msgr2=0x7fa5c0198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c5c33640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c0102d30 0x7fa5c0198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c5c33640 1 -- 172.21.15.73:0/3629300629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c01082a0 msgr2=0x7fa5c019cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c5c33640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c01082a0 0x7fa5c019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c5c33640 1 -- 172.21.15.73:0/3629300629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c019d5f0 con 0x7fa5c01036e0 2024-09-10T07:48:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c6434640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c0102d30 0x7fa5c0198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.081+0000 7fa5c5c33640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01036e0 0x7fa5c0198b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0005940 tx=0x7fa5b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.082+0000 7fa5b77fe640 1 -- 172.21.15.73:0/3629300629 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b003f030 con 0x7fa5c01036e0 2024-09-10T07:48:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.082+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c019d880 con 0x7fa5c01036e0 2024-09-10T07:48:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.082+0000 7fa5b77fe640 1 -- 172.21.15.73:0/3629300629 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5b0003ce0 con 0x7fa5c01036e0 2024-09-10T07:48:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.082+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c01a51c0 con 0x7fa5c01036e0 2024-09-10T07:48:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.082+0000 7fa5b77fe640 1 -- 172.21.15.73:0/3629300629 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0035070 con 0x7fa5c01036e0 2024-09-10T07:48:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.083+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5c0062900 con 0x7fa5c01036e0 2024-09-10T07:48:10.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.084+0000 7fa5b77fe640 1 -- 172.21.15.73:0/3629300629 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa5b0042030 con 0x7fa5c01036e0 2024-09-10T07:48:10.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.085+0000 7fa5b77fe640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5ac0a2c10 0x7fa5ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:10.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.085+0000 7fa5c6434640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5ac0a2c10 0x7fa5ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:10.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.085+0000 7fa5b77fe640 1 -- 172.21.15.73:0/3629300629 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fa5b00ef720 con 0x7fa5c01036e0 2024-09-10T07:48:10.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.085+0000 7fa5b77fe640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] conn(0x7fa5ac0ac8c0 0x7fa5ac0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:10.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.085+0000 7fa5b77fe640 1 -- 172.21.15.73:0/3629300629 --> [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5ac0af430 con 0x7fa5ac0ac8c0 2024-09-10T07:48:10.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.085+0000 7fa5b77fe640 1 -- 172.21.15.73:0/3629300629 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa5b00f6050 con 0x7fa5c01036e0 2024-09-10T07:48:10.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.086+0000 7fa5c6c35640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] conn(0x7fa5ac0ac8c0 0x7fa5ac0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:10.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.086+0000 7fa5c6434640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5ac0a2c10 0x7fa5ac0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0058c0 tx=0x7fa5bc005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:10.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.086+0000 7fa5c6c35640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] conn(0x7fa5ac0ac8c0 0x7fa5ac0aed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:10.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.087+0000 7fa5b77fe640 1 -- 172.21.15.73:0/3629300629 <== osd.7 v2:172.21.15.102:6816/120865394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5ac0af430 con 0x7fa5ac0ac8c0 2024-09-10T07:48:10.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.101+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 --> [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa5c0062d00 con 0x7fa5ac0ac8c0 2024-09-10T07:48:10.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.101+0000 7fa5b77fe640 1 -- 172.21.15.73:0/3629300629 <== osd.7 v2:172.21.15.102:6816/120865394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa5c0062d00 con 0x7fa5ac0ac8c0 2024-09-10T07:48:10.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 >> [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] conn(0x7fa5ac0ac8c0 msgr2=0x7fa5ac0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] conn(0x7fa5ac0ac8c0 0x7fa5ac0aed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5ac0a2c10 msgr2=0x7fa5ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5ac0a2c10 0x7fa5ac0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0058c0 tx=0x7fa5bc005ec0 comp rx=0 tx=0).stop 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01036e0 msgr2=0x7fa5c0198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 --2- 172.21.15.73:0/3629300629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c01036e0 0x7fa5c0198b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0005940 tx=0x7fa5b00042f0 comp rx=0 tx=0).stop 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c6c35640 1 -- 172.21.15.73:0/3629300629 reap_dead start 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 shutdown_connections 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 >> 172.21.15.73:0/3629300629 conn(0x7fa5c00fc7d0 msgr2=0x7fa5c0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 shutdown_connections 2024-09-10T07:48:10.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:10.102+0000 7fa5c8698640 1 -- 172.21.15.73:0/3629300629 wait complete. 2024-09-10T07:48:10.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:09 smithi102 ceph-mon[35514]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-10T07:48:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:09 smithi159 ceph-mon[35522]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-10T07:48:11.381 INFO:teuthology.orchestra.run.smithi073.stdout:201863462953 2024-09-10T07:48:11.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T07:48:11.531 INFO:teuthology.orchestra.run.smithi073.stdout:103079215165 2024-09-10T07:48:11.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T07:48:11.876 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:11 smithi073 ceph-mon[30850]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T07:48:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:11 smithi102 ceph-mon[35514]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T07:48:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:11 smithi159 ceph-mon[35522]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T07:48:12.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.157+0000 7f8ef2d40640 1 -- 172.21.15.73:0/761886790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8eec102780 msgr2=0x7f8eec1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:12.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.157+0000 7f8ef2d40640 1 --2- 172.21.15.73:0/761886790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8eec102780 0x7f8eec1067d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009900 tx=0x7f8ed802a410 comp rx=0 tx=0).stop 2024-09-10T07:48:12.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 -- 172.21.15.73:0/761886790 shutdown_connections 2024-09-10T07:48:12.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 --2- 172.21.15.73:0/761886790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eec106f00 0x7f8eec10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:12.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 --2- 172.21.15.73:0/761886790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8eec102780 0x7f8eec1067d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:12.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 --2- 172.21.15.73:0/761886790 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8eec101dd0 0x7f8eec1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 -- 172.21.15.73:0/761886790 >> 172.21.15.73:0/761886790 conn(0x7f8eec0fd8b0 msgr2=0x7f8eec0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 -- 172.21.15.73:0/761886790 shutdown_connections 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 -- 172.21.15.73:0/761886790 wait complete. 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 Processor -- start 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 -- start start 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8eec101dd0 0x7f8eec198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8eec102780 0x7f8eec198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eec106f00 0x7f8eec19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8eec111f60 con 0x7f8eec101dd0 2024-09-10T07:48:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8eec111de0 con 0x7f8eec102780 2024-09-10T07:48:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef2d40640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8eec1120e0 con 0x7f8eec106f00 2024-09-10T07:48:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.158+0000 7f8ef0adc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8eec101dd0 0x7f8eec198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef0adc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8eec101dd0 0x7f8eec198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43878/0 (socket says 172.21.15.73:43878) 2024-09-10T07:48:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef0adc640 1 -- 172.21.15.73:0/3460069541 learned_addr learned my addr 172.21.15.73:0/3460069541 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8eebfff640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8eec102780 0x7f8eec198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef12dd640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eec106f00 0x7f8eec19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef0adc640 1 -- 172.21.15.73:0/3460069541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eec106f00 msgr2=0x7f8eec19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef0adc640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eec106f00 0x7f8eec19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef0adc640 1 -- 172.21.15.73:0/3460069541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8eec102780 msgr2=0x7f8eec198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef0adc640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8eec102780 0x7f8eec198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef0adc640 1 -- 172.21.15.73:0/3460069541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eec19d400 con 0x7f8eec101dd0 2024-09-10T07:48:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef0adc640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8eec101dd0 0x7f8eec198450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000e9f0 tx=0x7f8ee000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ee9ffb640 1 -- 172.21.15.73:0/3460069541 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000cd80 con 0x7f8eec101dd0 2024-09-10T07:48:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eec19d6f0 con 0x7f8eec101dd0 2024-09-10T07:48:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ee9ffb640 1 -- 172.21.15.73:0/3460069541 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ee0010910 con 0x7f8eec101dd0 2024-09-10T07:48:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.159+0000 7f8ee9ffb640 1 -- 172.21.15.73:0/3460069541 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0018990 con 0x7f8eec101dd0 2024-09-10T07:48:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.160+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eec1a4fd0 con 0x7f8eec101dd0 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.160+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8eec062980 con 0x7f8eec101dd0 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.162+0000 7f8ee9ffb640 1 -- 172.21.15.73:0/3460069541 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8ee0010ac0 con 0x7f8eec101dd0 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.162+0000 7f8ee9ffb640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8edc0a2c10 0x7f8edc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.162+0000 7f8eebfff640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8edc0a2c10 0x7f8edc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.162+0000 7f8ee9ffb640 1 -- 172.21.15.73:0/3460069541 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f8ee00cfc20 con 0x7f8eec101dd0 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.163+0000 7f8ee9ffb640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] conn(0x7f8edc0ac8c0 0x7f8edc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.163+0000 7f8ee9ffb640 1 -- 172.21.15.73:0/3460069541 --> [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ee0022e50 con 0x7f8edc0ac8c0 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.163+0000 7f8ee9ffb640 1 -- 172.21.15.73:0/3460069541 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f8ee00d0070 con 0x7f8eec101dd0 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.163+0000 7f8ef12dd640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] conn(0x7f8edc0ac8c0 0x7f8edc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.163+0000 7f8eebfff640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8edc0a2c10 0x7f8edc0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009230 tx=0x7f8ed80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.163+0000 7f8ef12dd640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] conn(0x7f8edc0ac8c0 0x7f8edc0aed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.164+0000 7f8ee9ffb640 1 -- 172.21.15.73:0/3460069541 <== osd.0 v2:172.21.15.73:6802/2484484549 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ee0022e50 con 0x7f8edc0ac8c0 2024-09-10T07:48:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.190+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 --> [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8eec062e00 con 0x7f8edc0ac8c0 2024-09-10T07:48:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.190+0000 7f8ee9ffb640 1 -- 172.21.15.73:0/3460069541 <== osd.0 v2:172.21.15.73:6802/2484484549 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8eec062e00 con 0x7f8edc0ac8c0 2024-09-10T07:48:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] conn(0x7f8edc0ac8c0 msgr2=0x7f8edc0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] conn(0x7f8edc0ac8c0 0x7f8edc0aed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8edc0a2c10 msgr2=0x7f8edc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f8edc0a2c10 0x7f8edc0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009230 tx=0x7f8ed80058d0 comp rx=0 tx=0).stop 2024-09-10T07:48:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8eec101dd0 msgr2=0x7f8eec198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 --2- 172.21.15.73:0/3460069541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8eec101dd0 0x7f8eec198450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000e9f0 tx=0x7f8ee000eeb0 comp rx=0 tx=0).stop 2024-09-10T07:48:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef12dd640 1 -- 172.21.15.73:0/3460069541 reap_dead start 2024-09-10T07:48:12.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 shutdown_connections 2024-09-10T07:48:12.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 >> 172.21.15.73:0/3460069541 conn(0x7f8eec0fd8b0 msgr2=0x7f8eec0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:12.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 shutdown_connections 2024-09-10T07:48:12.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:12.191+0000 7f8ef2d40640 1 -- 172.21.15.73:0/3460069541 wait complete. 2024-09-10T07:48:12.579 INFO:teuthology.orchestra.run.smithi073.stdout:184683593773 2024-09-10T07:48:12.579 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T07:48:13.252 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:13.404 INFO:teuthology.orchestra.run.smithi073.stdout:266287972383 2024-09-10T07:48:13.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T07:48:13.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.715+0000 7f7ba30c3640 1 -- 172.21.15.73:0/1879508692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9c103660 msgr2=0x7f7b9c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:13.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.715+0000 7f7ba30c3640 1 --2- 172.21.15.73:0/1879508692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9c103660 0x7f7b9c10bb50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009900 tx=0x7f7b9002a480 comp rx=0 tx=0).stop 2024-09-10T07:48:13.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.715+0000 7f7ba30c3640 1 -- 172.21.15.73:0/1879508692 shutdown_connections 2024-09-10T07:48:13.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.715+0000 7f7ba30c3640 1 --2- 172.21.15.73:0/1879508692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b9c10c170 0x7f7b9c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:13.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.715+0000 7f7ba30c3640 1 --2- 172.21.15.73:0/1879508692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9c103660 0x7f7b9c10bb50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:13.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.715+0000 7f7ba30c3640 1 --2- 172.21.15.73:0/1879508692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b9c102d40 0x7f7b9c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:13.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.715+0000 7f7ba30c3640 1 -- 172.21.15.73:0/1879508692 >> 172.21.15.73:0/1879508692 conn(0x7f7b9c0fc7a0 msgr2=0x7f7b9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:13.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.715+0000 7f7ba30c3640 1 -- 172.21.15.73:0/1879508692 shutdown_connections 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.715+0000 7f7ba30c3640 1 -- 172.21.15.73:0/1879508692 wait complete. 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba30c3640 1 Processor -- start 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba30c3640 1 -- start start 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba30c3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9c102d40 0x7f7b9c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba30c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b9c103660 0x7f7b9c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba30c3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b9c10c170 0x7f7b9c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba30c3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c112030 con 0x7f7b9c102d40 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba30c3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c111eb0 con 0x7f7b9c103660 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba30c3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c1121b0 con 0x7f7b9c10c170 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba0e5f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9c102d40 0x7f7b9c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba0e5f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9c102d40 0x7f7b9c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43910/0 (socket says 172.21.15.73:43910) 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba0e5f640 1 -- 172.21.15.73:0/592307840 learned_addr learned my addr 172.21.15.73:0/592307840 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.716+0000 7f7ba1660640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b9c10c170 0x7f7b9c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7b9bfff640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b9c103660 0x7f7b9c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7ba0e5f640 1 -- 172.21.15.73:0/592307840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b9c10c170 msgr2=0x7f7b9c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7ba0e5f640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b9c10c170 0x7f7b9c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7ba0e5f640 1 -- 172.21.15.73:0/592307840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b9c103660 msgr2=0x7f7b9c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7ba0e5f640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b9c103660 0x7f7b9c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7ba0e5f640 1 -- 172.21.15.73:0/592307840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c1a6a90 con 0x7f7b9c102d40 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7ba1660640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b9c10c170 0x7f7b9c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7b9bfff640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b9c103660 0x7f7b9c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7ba0e5f640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9c102d40 0x7f7b9c1009a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00b4a0 tx=0x7f7b8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7b99ffb640 1 -- 172.21.15.73:0/592307840 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c014070 con 0x7f7b9c102d40 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7b99ffb640 1 -- 172.21.15.73:0/592307840 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b8c010af0 con 0x7f7b9c102d40 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b9c1a6d80 con 0x7f7b9c102d40 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7b99ffb640 1 -- 172.21.15.73:0/592307840 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c017d10 con 0x7f7b9c102d40 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.717+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9c1a7260 con 0x7f7b9c102d40 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.718+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b9c062880 con 0x7f7b9c102d40 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.719+0000 7f7b99ffb640 1 -- 172.21.15.73:0/592307840 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7b8c017070 con 0x7f7b9c102d40 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.720+0000 7f7b99ffb640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7b840a2c90 0x7f7b840a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.720+0000 7f7b9bfff640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7b840a2c90 0x7f7b840a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.720+0000 7f7b99ffb640 1 -- 172.21.15.73:0/592307840 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f7b8c0ce8b0 con 0x7f7b9c102d40 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.720+0000 7f7b99ffb640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] conn(0x7f7b840ac940 0x7f7b840aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.720+0000 7f7b99ffb640 1 -- 172.21.15.73:0/592307840 --> [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b840af4b0 con 0x7f7b840ac940 2024-09-10T07:48:13.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.720+0000 7f7b99ffb640 1 -- 172.21.15.73:0/592307840 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f7b8c0ced00 con 0x7f7b9c102d40 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.721+0000 7f7b9bfff640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7b840a2c90 0x7f7b840a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b90000c00 tx=0x7f7b90032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.721+0000 7f7ba1660640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] conn(0x7f7b840ac940 0x7f7b840aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.721+0000 7f7ba1660640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] conn(0x7f7b840ac940 0x7f7b840aede0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.722+0000 7f7b99ffb640 1 -- 172.21.15.73:0/592307840 <== osd.2 v2:172.21.15.159:6800/399686277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b840af4b0 con 0x7f7b840ac940 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.735+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 --> [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b9c062d00 con 0x7f7b840ac940 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7b99ffb640 1 -- 172.21.15.73:0/592307840 <== osd.2 v2:172.21.15.159:6800/399686277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7b9c062d00 con 0x7f7b840ac940 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 >> [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] conn(0x7f7b840ac940 msgr2=0x7f7b840aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] conn(0x7f7b840ac940 0x7f7b840aede0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7b840a2c90 msgr2=0x7f7b840a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7b840a2c90 0x7f7b840a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b90000c00 tx=0x7f7b90032d50 comp rx=0 tx=0).stop 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9c102d40 msgr2=0x7f7b9c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 --2- 172.21.15.73:0/592307840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9c102d40 0x7f7b9c1009a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00b4a0 tx=0x7f7b8c00b960 comp rx=0 tx=0).stop 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba1660640 1 -- 172.21.15.73:0/592307840 reap_dead start 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 shutdown_connections 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 >> 172.21.15.73:0/592307840 conn(0x7f7b9c0fc7a0 msgr2=0x7f7b9c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:13.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 shutdown_connections 2024-09-10T07:48:13.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.736+0000 7f7ba30c3640 1 -- 172.21.15.73:0/592307840 wait complete. 2024-09-10T07:48:13.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:13 smithi073 ceph-mon[30850]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-10T07:48:14.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:13 smithi102 ceph-mon[35514]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-10T07:48:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:13 smithi159 ceph-mon[35522]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-10T07:48:14.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.314+0000 7fe5b675b640 1 -- 172.21.15.73:0/2634691379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5b0102790 msgr2=0x7fe5b01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:14.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.314+0000 7fe5b675b640 1 --2- 172.21.15.73:0/2634691379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5b0102790 0x7fe5b01067e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009900 tx=0x7fe5a402a410 comp rx=0 tx=0).stop 2024-09-10T07:48:14.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.314+0000 7fe5b675b640 1 -- 172.21.15.73:0/2634691379 shutdown_connections 2024-09-10T07:48:14.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.314+0000 7fe5b675b640 1 --2- 172.21.15.73:0/2634691379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5b0106f10 0x7fe5b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:14.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.314+0000 7fe5b675b640 1 --2- 172.21.15.73:0/2634691379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5b0102790 0x7fe5b01067e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:14.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.314+0000 7fe5b675b640 1 --2- 172.21.15.73:0/2634691379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b0101de0 0x7fe5b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:14.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.314+0000 7fe5b675b640 1 -- 172.21.15.73:0/2634691379 >> 172.21.15.73:0/2634691379 conn(0x7fe5b00fd8c0 msgr2=0x7fe5b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:14.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.314+0000 7fe5b675b640 1 -- 172.21.15.73:0/2634691379 shutdown_connections 2024-09-10T07:48:14.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.314+0000 7fe5b675b640 1 -- 172.21.15.73:0/2634691379 wait complete. 2024-09-10T07:48:14.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.315+0000 7fe5b675b640 1 Processor -- start 2024-09-10T07:48:14.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.315+0000 7fe5b675b640 1 -- start start 2024-09-10T07:48:14.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.315+0000 7fe5b675b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5b0101de0 0x7fe5b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:14.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.315+0000 7fe5b675b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5b0102790 0x7fe5b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.315+0000 7fe5b675b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b0106f10 0x7fe5b0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.315+0000 7fe5b675b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0111f70 con 0x7fe5b0102790 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.315+0000 7fe5b675b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0111df0 con 0x7fe5b0101de0 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.315+0000 7fe5b675b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01120f0 con 0x7fe5b0106f10 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.315+0000 7fe5af7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5b0102790 0x7fe5b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5af7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5b0102790 0x7fe5b0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43924/0 (socket says 172.21.15.73:43924) 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5af7fe640 1 -- 172.21.15.73:0/2200170325 learned_addr learned my addr 172.21.15.73:0/2200170325 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5affff640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5b0101de0 0x7fe5b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5b4cf8640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b0106f10 0x7fe5b0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5af7fe640 1 -- 172.21.15.73:0/2200170325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b0106f10 msgr2=0x7fe5b0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5af7fe640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b0106f10 0x7fe5b0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5af7fe640 1 -- 172.21.15.73:0/2200170325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5b0101de0 msgr2=0x7fe5b00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5af7fe640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5b0101de0 0x7fe5b00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:14.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5af7fe640 1 -- 172.21.15.73:0/2200170325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b01a6970 con 0x7fe5b0102790 2024-09-10T07:48:14.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5b4cf8640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b0106f10 0x7fe5b0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:14.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5af7fe640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5b0102790 0x7fe5b0074a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4006010 tx=0x7fe5a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:14.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5ad7fa640 1 -- 172.21.15.73:0/2200170325 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a403f030 con 0x7fe5b0102790 2024-09-10T07:48:14.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b01a6c00 con 0x7fe5b0102790 2024-09-10T07:48:14.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5ad7fa640 1 -- 172.21.15.73:0/2200170325 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a4003ce0 con 0x7fe5b0102790 2024-09-10T07:48:14.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.316+0000 7fe5ad7fa640 1 -- 172.21.15.73:0/2200170325 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4035070 con 0x7fe5b0102790 2024-09-10T07:48:14.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.317+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b01a7130 con 0x7fe5b0102790 2024-09-10T07:48:14.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.318+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5b0062880 con 0x7fe5b0102790 2024-09-10T07:48:14.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.319+0000 7fe5ad7fa640 1 -- 172.21.15.73:0/2200170325 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe5a4042030 con 0x7fe5b0102790 2024-09-10T07:48:14.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.319+0000 7fe5ad7fa640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe5980a2c10 0x7fe5980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:14.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.320+0000 7fe5affff640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe5980a2c10 0x7fe5980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:14.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.320+0000 7fe5ad7fa640 1 -- 172.21.15.73:0/2200170325 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe5a40ef330 con 0x7fe5b0102790 2024-09-10T07:48:14.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.320+0000 7fe5ad7fa640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] conn(0x7fe5980ac8c0 0x7fe5980aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:14.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.320+0000 7fe5ad7fa640 1 -- 172.21.15.73:0/2200170325 --> [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5a403be50 con 0x7fe5980ac8c0 2024-09-10T07:48:14.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.320+0000 7fe5ad7fa640 1 -- 172.21.15.73:0/2200170325 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe5a40f6050 con 0x7fe5b0102790 2024-09-10T07:48:14.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.320+0000 7fe5b4cf8640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] conn(0x7fe5980ac8c0 0x7fe5980aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:14.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.320+0000 7fe5affff640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe5980a2c10 0x7fe5980a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0005fd0 tx=0x7fe5a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:14.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.321+0000 7fe5b4cf8640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] conn(0x7fe5980ac8c0 0x7fe5980aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:14.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.322+0000 7fe5ad7fa640 1 -- 172.21.15.73:0/2200170325 <== osd.8 v2:172.21.15.159:6816/651574566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5a403be50 con 0x7fe5980ac8c0 2024-09-10T07:48:14.325 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.337+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 --> [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5b0062cb0 con 0x7fe5980ac8c0 2024-09-10T07:48:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.337+0000 7fe5ad7fa640 1 -- 172.21.15.73:0/2200170325 <== osd.8 v2:172.21.15.159:6816/651574566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe5b0062cb0 con 0x7fe5980ac8c0 2024-09-10T07:48:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 >> [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] conn(0x7fe5980ac8c0 msgr2=0x7fe5980aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] conn(0x7fe5980ac8c0 0x7fe5980aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe5980a2c10 msgr2=0x7fe5980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe5980a2c10 0x7fe5980a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0005fd0 tx=0x7fe5a000b390 comp rx=0 tx=0).stop 2024-09-10T07:48:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5b0102790 msgr2=0x7fe5b0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 --2- 172.21.15.73:0/2200170325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5b0102790 0x7fe5b0074a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4006010 tx=0x7fe5a40042f0 comp rx=0 tx=0).stop 2024-09-10T07:48:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b4cf8640 1 -- 172.21.15.73:0/2200170325 reap_dead start 2024-09-10T07:48:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 shutdown_connections 2024-09-10T07:48:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 >> 172.21.15.73:0/2200170325 conn(0x7fe5b00fd8c0 msgr2=0x7fe5b00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 shutdown_connections 2024-09-10T07:48:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:14.338+0000 7fe5b675b640 1 -- 172.21.15.73:0/2200170325 wait complete. 2024-09-10T07:48:15.111 INFO:teuthology.orchestra.run.smithi073.stdout:34359738444 2024-09-10T07:48:15.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T07:48:15.613 INFO:teuthology.orchestra.run.smithi073.stdout:77309411393 2024-09-10T07:48:15.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T07:48:16.012 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:15 smithi073 ceph-mon[30850]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T07:48:16.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.012+0000 7ff1917ee640 1 -- 172.21.15.73:0/695195348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c106a80 msgr2=0x7ff18c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.012+0000 7ff1917ee640 1 --2- 172.21.15.73:0/695195348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c106a80 0x7ff18c106e60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009930 tx=0x7ff17c02a420 comp rx=0 tx=0).stop 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.012+0000 7ff1917ee640 1 -- 172.21.15.73:0/695195348 shutdown_connections 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.012+0000 7ff1917ee640 1 --2- 172.21.15.73:0/695195348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff18c101420 0x7ff18c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.012+0000 7ff1917ee640 1 --2- 172.21.15.73:0/695195348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18c100a80 0x7ff18c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.012+0000 7ff1917ee640 1 --2- 172.21.15.73:0/695195348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c106a80 0x7ff18c106e60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.012+0000 7ff1917ee640 1 -- 172.21.15.73:0/695195348 >> 172.21.15.73:0/695195348 conn(0x7ff18c0fc7a0 msgr2=0x7ff18c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.012+0000 7ff1917ee640 1 -- 172.21.15.73:0/695195348 shutdown_connections 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.012+0000 7ff1917ee640 1 -- 172.21.15.73:0/695195348 wait complete. 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff1917ee640 1 Processor -- start 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff1917ee640 1 -- start start 2024-09-10T07:48:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff1917ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c100a80 0x7ff18c199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff1917ee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18c101420 0x7ff18c1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff1917ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff18c106a80 0x7ff18c1a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff1917ee640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c110f20 con 0x7ff18c100a80 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff1917ee640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c110da0 con 0x7ff18c101420 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff1917ee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1110a0 con 0x7ff18c106a80 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff18affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c100a80 0x7ff18c199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff18affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c100a80 0x7ff18c199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43936/0 (socket says 172.21.15.73:43936) 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff18affd640 1 -- 172.21.15.73:0/2391395603 learned_addr learned my addr 172.21.15.73:0/2391395603 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.013+0000 7ff18a7fc640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18c101420 0x7ff18c1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff18b7fe640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff18c106a80 0x7ff18c1a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff18affd640 1 -- 172.21.15.73:0/2391395603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff18c106a80 msgr2=0x7ff18c1a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff18affd640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff18c106a80 0x7ff18c1a44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff18affd640 1 -- 172.21.15.73:0/2391395603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18c101420 msgr2=0x7ff18c1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff18affd640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18c101420 0x7ff18c1999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff18affd640 1 -- 172.21.15.73:0/2391395603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c1a4a20 con 0x7ff18c100a80 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff18b7fe640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff18c106a80 0x7ff18c1a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff18affd640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c100a80 0x7ff18c199460 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009a50 tx=0x7ff17c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff173fff640 1 -- 172.21.15.73:0/2391395603 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c03f030 con 0x7ff18c100a80 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18c1a4bf0 con 0x7ff18c100a80 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff173fff640 1 -- 172.21.15.73:0/2391395603 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff17c003ad0 con 0x7ff18c100a80 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff173fff640 1 -- 172.21.15.73:0/2391395603 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c035070 con 0x7ff18c100a80 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.014+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18c1a5040 con 0x7ff18c100a80 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.015+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff18c100f60 con 0x7ff18c100a80 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.017+0000 7ff173fff640 1 -- 172.21.15.73:0/2391395603 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff17c042030 con 0x7ff18c100a80 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.017+0000 7ff173fff640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1740a2c10 0x7ff1740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.017+0000 7ff18a7fc640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1740a2c10 0x7ff1740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:16.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.017+0000 7ff173fff640 1 -- 172.21.15.73:0/2391395603 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7ff17c0efd60 con 0x7ff18c100a80 2024-09-10T07:48:16.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.018+0000 7ff18a7fc640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1740a2c10 0x7ff1740a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff18c06b2e0 tx=0x7ff180009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:16.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.020+0000 7ff173fff640 1 -- 172.21.15.73:0/2391395603 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff17c0bcb40 con 0x7ff18c100a80 2024-09-10T07:48:16.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:15 smithi102 ceph-mon[35514]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T07:48:16.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:15 smithi159 ceph-mon[35522]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T07:48:16.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.194+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff18c06ad80 con 0x7ff18c100a80 2024-09-10T07:48:16.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.194+0000 7ff173fff640 1 -- 172.21.15.73:0/2391395603 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff17c0bc440 con 0x7ff18c100a80 2024-09-10T07:48:16.193 INFO:teuthology.orchestra.run.smithi073.stdout:154618822707 2024-09-10T07:48:16.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1740a2c10 msgr2=0x7ff1740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1740a2c10 0x7ff1740a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff18c06b2e0 tx=0x7ff180009110 comp rx=0 tx=0).stop 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c100a80 msgr2=0x7ff18c199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c100a80 0x7ff18c199460 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009a50 tx=0x7ff17c004270 comp rx=0 tx=0).stop 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 shutdown_connections 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1740a2c10 0x7ff1740a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff18c106a80 0x7ff18c1a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18c101420 0x7ff18c1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 --2- 172.21.15.73:0/2391395603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18c100a80 0x7ff18c199460 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 >> 172.21.15.73:0/2391395603 conn(0x7ff18c0fc7a0 msgr2=0x7ff18c0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 shutdown_connections 2024-09-10T07:48:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.196+0000 7ff1917ee640 1 -- 172.21.15.73:0/2391395603 wait complete. 2024-09-10T07:48:16.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/549479280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7cc100a80 msgr2=0x7fa7cc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 --2- 172.21.15.73:0/549479280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7cc100a80 0x7fa7cc100ee0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8009930 tx=0x7fa7b802a420 comp rx=0 tx=0).stop 2024-09-10T07:48:16.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/549479280 shutdown_connections 2024-09-10T07:48:16.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 --2- 172.21.15.73:0/549479280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7cc101420 0x7fa7cc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 --2- 172.21.15.73:0/549479280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7cc100a80 0x7fa7cc100ee0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 --2- 172.21.15.73:0/549479280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7cc106a80 0x7fa7cc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/549479280 >> 172.21.15.73:0/549479280 conn(0x7fa7cc0fc7a0 msgr2=0x7fa7cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/549479280 shutdown_connections 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/549479280 wait complete. 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 Processor -- start 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.626+0000 7fa7d2d0f640 1 -- start start 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d2d0f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7cc100a80 0x7fa7cc10e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d2d0f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7cc101420 0x7fa7cc10e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d2d0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7cc106a80 0x7fa7cc10ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:16.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d2d0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc111fa0 con 0x7fa7cc106a80 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d2d0f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc111e20 con 0x7fa7cc100a80 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d2d0f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc112120 con 0x7fa7cc101420 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d12ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7cc106a80 0x7fa7cc10ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d12ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7cc106a80 0x7fa7cc10ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43950/0 (socket says 172.21.15.73:43950) 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d12ac640 1 -- 172.21.15.73:0/1344041877 learned_addr learned my addr 172.21.15.73:0/1344041877 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7cbfff640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7cc101420 0x7fa7cc10e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d0aab640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7cc100a80 0x7fa7cc10e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d12ac640 1 -- 172.21.15.73:0/1344041877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7cc101420 msgr2=0x7fa7cc10e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d12ac640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7cc101420 0x7fa7cc10e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d12ac640 1 -- 172.21.15.73:0/1344041877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7cc100a80 msgr2=0x7fa7cc10e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d12ac640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7cc100a80 0x7fa7cc10e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d12ac640 1 -- 172.21.15.73:0/1344041877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc1a6950 con 0x7fa7cc106a80 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d0aab640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7cc100a80 0x7fa7cc10e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d12ac640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7cc106a80 0x7fa7cc10ee60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400eaa0 tx=0x7fa7c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7c9ffb640 1 -- 172.21.15.73:0/1344041877 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400cdb0 con 0x7fa7cc106a80 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7c9ffb640 1 -- 172.21.15.73:0/1344041877 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7c4005020 con 0x7fa7cc106a80 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7cc1a6c40 con 0x7fa7cc106a80 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7c9ffb640 1 -- 172.21.15.73:0/1344041877 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40116b0 con 0x7fa7cc106a80 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.627+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7cc1a7150 con 0x7fa7cc106a80 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.628+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7cc0628c0 con 0x7fa7cc106a80 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.629+0000 7fa7c9ffb640 1 -- 172.21.15.73:0/1344041877 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa7c4005560 con 0x7fa7cc106a80 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.630+0000 7fa7c9ffb640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa7bc0a2c90 0x7fa7bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.630+0000 7fa7d0aab640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa7bc0a2c90 0x7fa7bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:16.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.630+0000 7fa7c9ffb640 1 -- 172.21.15.73:0/1344041877 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fa7c40cf850 con 0x7fa7cc106a80 2024-09-10T07:48:16.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.630+0000 7fa7c9ffb640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] conn(0x7fa7bc0ac940 0x7fa7bc0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:16.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.630+0000 7fa7c9ffb640 1 -- 172.21.15.73:0/1344041877 --> [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7c4014ec0 con 0x7fa7bc0ac940 2024-09-10T07:48:16.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.630+0000 7fa7c9ffb640 1 -- 172.21.15.73:0/1344041877 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa7c40cfca0 con 0x7fa7cc106a80 2024-09-10T07:48:16.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.631+0000 7fa7d0aab640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa7bc0a2c90 0x7fa7bc0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009930 tx=0x7fa7c0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:16.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.631+0000 7fa7cbfff640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] conn(0x7fa7bc0ac940 0x7fa7bc0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:16.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.631+0000 7fa7cbfff640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] conn(0x7fa7bc0ac940 0x7fa7bc0aede0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:16.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.632+0000 7fa7c9ffb640 1 -- 172.21.15.73:0/1344041877 <== osd.1 v2:172.21.15.102:6800/2799530792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7c4014ec0 con 0x7fa7bc0ac940 2024-09-10T07:48:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.645+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 --> [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa7cc062d40 con 0x7fa7bc0ac940 2024-09-10T07:48:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.646+0000 7fa7c9ffb640 1 -- 172.21.15.73:0/1344041877 <== osd.1 v2:172.21.15.102:6800/2799530792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa7cc062d40 con 0x7fa7bc0ac940 2024-09-10T07:48:16.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.646+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 >> [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] conn(0x7fa7bc0ac940 msgr2=0x7fa7bc0aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.646+0000 7fa7d2d0f640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] conn(0x7fa7bc0ac940 0x7fa7bc0aede0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:16.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.647+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa7bc0a2c90 msgr2=0x7fa7bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.647+0000 7fa7d2d0f640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa7bc0a2c90 0x7fa7bc0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009930 tx=0x7fa7c0008040 comp rx=0 tx=0).stop 2024-09-10T07:48:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.647+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7cc106a80 msgr2=0x7fa7cc10ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.647+0000 7fa7d2d0f640 1 --2- 172.21.15.73:0/1344041877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7cc106a80 0x7fa7cc10ee60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400eaa0 tx=0x7fa7c400ef60 comp rx=0 tx=0).stop 2024-09-10T07:48:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.647+0000 7fa7d12ac640 1 -- 172.21.15.73:0/1344041877 reap_dead start 2024-09-10T07:48:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.647+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 shutdown_connections 2024-09-10T07:48:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.647+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 >> 172.21.15.73:0/1344041877 conn(0x7fa7cc0fc7a0 msgr2=0x7fa7cc0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.647+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 shutdown_connections 2024-09-10T07:48:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:16.647+0000 7fa7d2d0f640 1 -- 172.21.15.73:0/1344041877 wait complete. 2024-09-10T07:48:16.928 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:16 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2391395603' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T07:48:17.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:16 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2391395603' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T07:48:17.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:16 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2391395603' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T07:48:17.254 INFO:teuthology.orchestra.run.smithi073.stdout:55834574919 2024-09-10T07:48:17.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T07:48:17.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.623+0000 7f258743a640 1 -- 172.21.15.73:0/1690128939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580112b90 msgr2=0x7f2580114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.623+0000 7f258743a640 1 --2- 172.21.15.73:0/1690128939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580112b90 0x7f2580114f80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2578009ca0 tx=0x7f257802a950 comp rx=0 tx=0).stop 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.623+0000 7f258743a640 1 -- 172.21.15.73:0/1690128939 shutdown_connections 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.623+0000 7f258743a640 1 --2- 172.21.15.73:0/1690128939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580112b90 0x7f2580114f80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.623+0000 7f258743a640 1 --2- 172.21.15.73:0/1690128939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580074eb0 0x7f2580112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.623+0000 7f258743a640 1 --2- 172.21.15.73:0/1690128939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580074590 0x7f2580074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.623+0000 7f258743a640 1 -- 172.21.15.73:0/1690128939 >> 172.21.15.73:0/1690128939 conn(0x7f25800fd8c0 msgr2=0x7f25800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.623+0000 7f258743a640 1 -- 172.21.15.73:0/1690128939 shutdown_connections 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.623+0000 7f258743a640 1 -- 172.21.15.73:0/1690128939 wait complete. 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f258743a640 1 Processor -- start 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f258743a640 1 -- start start 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f258743a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580074590 0x7f25801a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f258743a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580074eb0 0x7f25801a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f258743a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580112b90 0x7f258019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f258743a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f25801185b0 con 0x7f2580112b90 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f258743a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2580118430 con 0x7f2580074590 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f258743a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2580118730 con 0x7f2580074eb0 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25859d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580112b90 0x7f258019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25859d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580112b90 0x7f258019e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43898/0 (socket says 172.21.15.73:43898) 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25859d7640 1 -- 172.21.15.73:0/1988076262 learned_addr learned my addr 172.21.15.73:0/1988076262 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25851d6640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580074590 0x7f25801a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25849d5640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580074eb0 0x7f25801a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25859d7640 1 -- 172.21.15.73:0/1988076262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580074eb0 msgr2=0x7f25801a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25859d7640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580074eb0 0x7f25801a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25859d7640 1 -- 172.21.15.73:0/1988076262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580074590 msgr2=0x7f25801a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25859d7640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2580074590 0x7f25801a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25859d7640 1 -- 172.21.15.73:0/1988076262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258019eff0 con 0x7f2580112b90 2024-09-10T07:48:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.624+0000 7f25849d5640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2580074eb0 0x7f25801a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.625+0000 7f25859d7640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580112b90 0x7f258019e8c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f257802ae70 tx=0x7f257802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.625+0000 7f25767fc640 1 -- 172.21.15.73:0/1988076262 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578034040 con 0x7f2580112b90 2024-09-10T07:48:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.625+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258019f280 con 0x7f2580112b90 2024-09-10T07:48:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.625+0000 7f25767fc640 1 -- 172.21.15.73:0/1988076262 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2578030920 con 0x7f2580112b90 2024-09-10T07:48:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.625+0000 7f25767fc640 1 -- 172.21.15.73:0/1988076262 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578045480 con 0x7f2580112b90 2024-09-10T07:48:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.625+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25801ab5d0 con 0x7f2580112b90 2024-09-10T07:48:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.626+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25800ffa80 con 0x7f2580112b90 2024-09-10T07:48:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.627+0000 7f25767fc640 1 -- 172.21.15.73:0/1988076262 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2578037020 con 0x7f2580112b90 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.627+0000 7f25767fc640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f256c0a2c10 0x7f256c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.628+0000 7f25851d6640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f256c0a2c10 0x7f256c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.628+0000 7f25767fc640 1 -- 172.21.15.73:0/1988076262 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f25780f03a0 con 0x7f2580112b90 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.628+0000 7f25767fc640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] conn(0x7f256c0ac8c0 0x7f256c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.628+0000 7f25767fc640 1 -- 172.21.15.73:0/1988076262 --> [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f256c0af430 con 0x7f256c0ac8c0 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.628+0000 7f25767fc640 1 -- 172.21.15.73:0/1988076262 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f25780f07f0 con 0x7f2580112b90 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.628+0000 7f25851d6640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f256c0a2c10 0x7f256c0a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f258019fa00 tx=0x7f257c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.628+0000 7f25849d5640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] conn(0x7f256c0ac8c0 0x7f256c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.629+0000 7f25849d5640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] conn(0x7f256c0ac8c0 0x7f256c0aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.629+0000 7f25767fc640 1 -- 172.21.15.73:0/1988076262 <== osd.10 v2:172.21.15.102:6824/2640871897 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f256c0af430 con 0x7f256c0ac8c0 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.644+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 --> [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2580075cd0 con 0x7f256c0ac8c0 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.644+0000 7f25767fc640 1 -- 172.21.15.73:0/1988076262 <== osd.10 v2:172.21.15.102:6824/2640871897 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2580075cd0 con 0x7f256c0ac8c0 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 >> [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] conn(0x7f256c0ac8c0 msgr2=0x7f256c0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:17.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] conn(0x7f256c0ac8c0 0x7f256c0aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f256c0a2c10 msgr2=0x7f256c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f256c0a2c10 0x7f256c0a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f258019fa00 tx=0x7f257c00b390 comp rx=0 tx=0).stop 2024-09-10T07:48:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580112b90 msgr2=0x7f258019e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 --2- 172.21.15.73:0/1988076262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2580112b90 0x7f258019e8c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f257802ae70 tx=0x7f257802f5b0 comp rx=0 tx=0).stop 2024-09-10T07:48:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f25859d7640 1 -- 172.21.15.73:0/1988076262 reap_dead start 2024-09-10T07:48:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 shutdown_connections 2024-09-10T07:48:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 >> 172.21.15.73:0/1988076262 conn(0x7f25800fd8c0 msgr2=0x7f25800ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 shutdown_connections 2024-09-10T07:48:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:13.645+0000 7f258743a640 1 -- 172.21.15.73:0/1988076262 wait complete. 2024-09-10T07:48:18.061 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:17 smithi073 ceph-mon[30850]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T07:48:18.061 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:17 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/56423660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T07:48:18.091 INFO:teuthology.orchestra.run.smithi073.stdout:287762808858 2024-09-10T07:48:18.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T07:48:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:17 smithi102 ceph-mon[35514]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T07:48:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:17 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/56423660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T07:48:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:17 smithi159 ceph-mon[35522]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T07:48:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:17 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/56423660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T07:48:18.774 INFO:teuthology.orchestra.run.smithi073.stdout:231928234021 2024-09-10T07:48:18.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T07:48:18.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.457+0000 7fd3eb737640 1 -- 172.21.15.73:0/2395469578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 msgr2=0x7fd3e4105930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:18.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.457+0000 7fd3eb737640 1 --2- 172.21.15.73:0/2395469578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 0x7fd3e4105930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009900 tx=0x7fd3d402a470 comp rx=0 tx=0).stop 2024-09-10T07:48:18.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.457+0000 7fd3eb737640 1 -- 172.21.15.73:0/2395469578 shutdown_connections 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.457+0000 7fd3eb737640 1 --2- 172.21.15.73:0/2395469578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e4105f50 0x7fd3e41063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.457+0000 7fd3eb737640 1 --2- 172.21.15.73:0/2395469578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 0x7fd3e4105930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.457+0000 7fd3eb737640 1 --2- 172.21.15.73:0/2395469578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3e4100b40 0x7fd3e4100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.457+0000 7fd3eb737640 1 -- 172.21.15.73:0/2395469578 >> 172.21.15.73:0/2395469578 conn(0x7fd3e40fc7d0 msgr2=0x7fd3e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.458+0000 7fd3eb737640 1 -- 172.21.15.73:0/2395469578 shutdown_connections 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.458+0000 7fd3eb737640 1 -- 172.21.15.73:0/2395469578 wait complete. 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.458+0000 7fd3eb737640 1 Processor -- start 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.458+0000 7fd3eb737640 1 -- start start 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.458+0000 7fd3eb737640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3e4100b40 0x7fd3e41a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.458+0000 7fd3eb737640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 0x7fd3e41a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3eb737640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e4105f50 0x7fd3e419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3eb737640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e41185d0 con 0x7fd3e4101460 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3eb737640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e4118450 con 0x7fd3e4105f50 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3eb737640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e4118750 con 0x7fd3e4100b40 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e8cd2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 0x7fd3e41a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e8cd2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 0x7fd3e41a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43970/0 (socket says 172.21.15.73:43970) 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e8cd2640 1 -- 172.21.15.73:0/56423660 learned_addr learned my addr 172.21.15.73:0/56423660 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e9cd4640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e4105f50 0x7fd3e419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e94d3640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3e4100b40 0x7fd3e41a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e8cd2640 1 -- 172.21.15.73:0/56423660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3e4100b40 msgr2=0x7fd3e41a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e8cd2640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3e4100b40 0x7fd3e41a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e8cd2640 1 -- 172.21.15.73:0/56423660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e4105f50 msgr2=0x7fd3e419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e8cd2640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e4105f50 0x7fd3e419e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e8cd2640 1 -- 172.21.15.73:0/56423660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e419f070 con 0x7fd3e4101460 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e94d3640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3e4100b40 0x7fd3e41a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3e8cd2640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 0x7fd3e41a4cc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4006010 tx=0x7fd3d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:18.891 INFO:teuthology.orchestra.run.smithi073.stdout:322122547222 2024-09-10T07:48:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3da7fc640 1 -- 172.21.15.73:0/56423660 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d403f030 con 0x7fd3e4101460 2024-09-10T07:48:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e419f300 con 0x7fd3e4101460 2024-09-10T07:48:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3da7fc640 1 -- 172.21.15.73:0/56423660 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3d4003ce0 con 0x7fd3e4101460 2024-09-10T07:48:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3da7fc640 1 -- 172.21.15.73:0/56423660 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4035070 con 0x7fd3e4101460 2024-09-10T07:48:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.459+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e41ab650 con 0x7fd3e4101460 2024-09-10T07:48:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.461+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e4105930 con 0x7fd3e4101460 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.461+0000 7fd3da7fc640 1 -- 172.21.15.73:0/56423660 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd3d4042030 con 0x7fd3e4101460 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.462+0000 7fd3da7fc640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd3d00a2c10 0x7fd3d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.462+0000 7fd3e94d3640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd3d00a2c10 0x7fd3d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.462+0000 7fd3da7fc640 1 -- 172.21.15.73:0/56423660 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fd3d40ef7d0 con 0x7fd3e4101460 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.462+0000 7fd3e94d3640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd3d00a2c10 0x7fd3d00a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd3e419fa80 tx=0x7fd3e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.466+0000 7fd3da7fc640 1 -- 172.21.15.73:0/56423660 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3d40bc670 con 0x7fd3e4101460 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.635+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd3e41ab820 con 0x7fd3e4101460 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.636+0000 7fd3da7fc640 1 -- 172.21.15.73:0/56423660 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd3d40bbf70 con 0x7fd3e4101460 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd3d00a2c10 msgr2=0x7fd3d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd3d00a2c10 0x7fd3d00a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd3e419fa80 tx=0x7fd3e0008040 comp rx=0 tx=0).stop 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 msgr2=0x7fd3e41a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 0x7fd3e41a4cc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4006010 tx=0x7fd3d40042f0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 shutdown_connections 2024-09-10T07:48:18.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fd3d00a2c10 0x7fd3d00a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e4105f50 0x7fd3e419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3e4101460 0x7fd3e41a4cc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 --2- 172.21.15.73:0/56423660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3e4100b40 0x7fd3e41a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:18.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 >> 172.21.15.73:0/56423660 conn(0x7fd3e40fc7d0 msgr2=0x7fd3e41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:18.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 shutdown_connections 2024-09-10T07:48:18.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:17.638+0000 7fd3eb737640 1 -- 172.21.15.73:0/56423660 wait complete. 2024-09-10T07:48:19.544 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547220 got 322122547222 for osd.11 2024-09-10T07:48:19.545 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:19.929 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:19 smithi073 ceph-mon[30850]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-10T07:48:19.942 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:19.957 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:19.986 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822706 got 154618822707 for osd.5 2024-09-10T07:48:19.987 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:20.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:19 smithi102 ceph-mon[35514]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-10T07:48:20.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:19 smithi159 ceph-mon[35522]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 -- 172.21.15.73:0/2407739609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102ef0 msgr2=0x7f757010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 --2- 172.21.15.73:0/2407739609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102ef0 0x7f757010da40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7568009ca0 tx=0x7f756802a950 comp rx=0 tx=0).stop 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 -- 172.21.15.73:0/2407739609 shutdown_connections 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 --2- 172.21.15.73:0/2407739609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102ef0 0x7f757010da40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 --2- 172.21.15.73:0/2407739609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7570102570 0x7f75701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 --2- 172.21.15.73:0/2407739609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7570100e20 0x7f7570101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 -- 172.21.15.73:0/2407739609 >> 172.21.15.73:0/2407739609 conn(0x7f75700fc7d0 msgr2=0x7f75700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 -- 172.21.15.73:0/2407739609 shutdown_connections 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 -- 172.21.15.73:0/2407739609 wait complete. 2024-09-10T07:48:20.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.627+0000 7f7576794640 1 Processor -- start 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7576794640 1 -- start start 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7576794640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7570100e20 0x7f7570199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7576794640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102570 0x7f7570199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7576794640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7570102ef0 0x7f75701a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7576794640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7570110fa0 con 0x7f7570102570 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7576794640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7570110e20 con 0x7f7570100e20 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7576794640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7570111120 con 0x7f7570102ef0 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7567fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102570 0x7f7570199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7567fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102570 0x7f7570199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58998/0 (socket says 172.21.15.73:58998) 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7567fff640 1 -- 172.21.15.73:0/1093021251 learned_addr learned my addr 172.21.15.73:0/1093021251 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7574d31640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7570102ef0 0x7f75701a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:20.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f756ffff640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7570100e20 0x7f7570199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7567fff640 1 -- 172.21.15.73:0/1093021251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7570102ef0 msgr2=0x7f75701a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7567fff640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7570102ef0 0x7f75701a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7567fff640 1 -- 172.21.15.73:0/1093021251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7570100e20 msgr2=0x7f7570199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7567fff640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7570100e20 0x7f7570199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7567fff640 1 -- 172.21.15.73:0/1093021251 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75701a4910 con 0x7f7570102570 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f756ffff640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7570100e20 0x7f7570199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f7567fff640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102570 0x7f7570199890 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f755800b4a0 tx=0x7f755800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f756dffb640 1 -- 172.21.15.73:0/1093021251 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558014070 con 0x7f7570102570 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.628+0000 7f756dffb640 1 -- 172.21.15.73:0/1093021251 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7558010af0 con 0x7f7570102570 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.629+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75701a4ae0 con 0x7f7570102570 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.629+0000 7f756dffb640 1 -- 172.21.15.73:0/1093021251 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558017d10 con 0x7f7570102570 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.629+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75701a4ff0 con 0x7f7570102570 2024-09-10T07:48:20.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.629+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75701021b0 con 0x7f7570102570 2024-09-10T07:48:20.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.631+0000 7f756dffb640 1 -- 172.21.15.73:0/1093021251 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7558017070 con 0x7f7570102570 2024-09-10T07:48:20.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.631+0000 7f756dffb640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f755c0a2c90 0x7f755c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:20.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.632+0000 7f756ffff640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f755c0a2c90 0x7f755c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:20.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.632+0000 7f756dffb640 1 -- 172.21.15.73:0/1093021251 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f75580ce8f0 con 0x7f7570102570 2024-09-10T07:48:20.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.632+0000 7f756ffff640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f755c0a2c90 0x7f755c0a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7560009b40 tx=0x7f7560005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.635+0000 7f756dffb640 1 -- 172.21.15.73:0/1093021251 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f755809b7e0 con 0x7f7570102570 2024-09-10T07:48:20.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.807+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7570101200 con 0x7f7570102570 2024-09-10T07:48:20.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.807+0000 7f756dffb640 1 -- 172.21.15.73:0/1093021251 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7570101200 con 0x7f7570102570 2024-09-10T07:48:20.807 INFO:teuthology.orchestra.run.smithi073.stdout:133143986234 2024-09-10T07:48:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.809+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f755c0a2c90 msgr2=0x7f755c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.809+0000 7f7576794640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f755c0a2c90 0x7f755c0a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7560009b40 tx=0x7f7560005e50 comp rx=0 tx=0).stop 2024-09-10T07:48:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102570 msgr2=0x7f7570199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102570 0x7f7570199890 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f755800b4a0 tx=0x7f755800b960 comp rx=0 tx=0).stop 2024-09-10T07:48:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 shutdown_connections 2024-09-10T07:48:20.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f755c0a2c90 0x7f755c0a5150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7570102ef0 0x7f75701a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7570102570 0x7f7570199890 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 --2- 172.21.15.73:0/1093021251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7570100e20 0x7f7570199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 >> 172.21.15.73:0/1093021251 conn(0x7f75700fc7d0 msgr2=0x7f7570106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 shutdown_connections 2024-09-10T07:48:20.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.810+0000 7f7576794640 1 -- 172.21.15.73:0/1093021251 wait complete. 2024-09-10T07:48:20.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 -- 172.21.15.73:0/371652379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64102790 msgr2=0x7f6e641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 --2- 172.21.15.73:0/371652379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64102790 0x7f6e641067e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009900 tx=0x7f6e5402a410 comp rx=0 tx=0).stop 2024-09-10T07:48:20.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 -- 172.21.15.73:0/371652379 shutdown_connections 2024-09-10T07:48:20.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 --2- 172.21.15.73:0/371652379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e64106f10 0x7f6e6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 --2- 172.21.15.73:0/371652379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64102790 0x7f6e641067e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 --2- 172.21.15.73:0/371652379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e64101de0 0x7f6e641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 -- 172.21.15.73:0/371652379 >> 172.21.15.73:0/371652379 conn(0x7f6e640fd8e0 msgr2=0x7f6e640ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 -- 172.21.15.73:0/371652379 shutdown_connections 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 -- 172.21.15.73:0/371652379 wait complete. 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 Processor -- start 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.811+0000 7f6e6b365640 1 -- start start 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e6b365640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e64101de0 0x7f6e6419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e6b365640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e64102790 0x7f6e6419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e6b365640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64106f10 0x7f6e6419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e6b365640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6e640760e0 con 0x7f6e64106f10 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e6b365640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6e64075f60 con 0x7f6e64102790 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e6b365640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6e64076260 con 0x7f6e64101de0 2024-09-10T07:48:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69902640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64106f10 0x7f6e6419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69902640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64106f10 0x7f6e6419efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59026/0 (socket says 172.21.15.73:59026) 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69101640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e64101de0 0x7f6e6419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69902640 1 -- 172.21.15.73:0/2148280564 learned_addr learned my addr 172.21.15.73:0/2148280564 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e68900640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e64102790 0x7f6e6419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69902640 1 -- 172.21.15.73:0/2148280564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e64101de0 msgr2=0x7f6e6419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69902640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e64101de0 0x7f6e6419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69902640 1 -- 172.21.15.73:0/2148280564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e64102790 msgr2=0x7f6e6419ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69902640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e64102790 0x7f6e6419ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69902640 1 -- 172.21.15.73:0/2148280564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6419f6b0 con 0x7f6e64106f10 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e69902640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64106f10 0x7f6e6419efd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00eaa0 tx=0x7f6e5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.812+0000 7f6e5a7fc640 1 -- 172.21.15.73:0/2148280564 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c00cdb0 con 0x7f6e64106f10 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.813+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6419f9a0 con 0x7f6e64106f10 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.813+0000 7f6e5a7fc640 1 -- 172.21.15.73:0/2148280564 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e5c005020 con 0x7f6e64106f10 2024-09-10T07:48:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.813+0000 7f6e5a7fc640 1 -- 172.21.15.73:0/2148280564 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0116b0 con 0x7f6e64106f10 2024-09-10T07:48:20.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.813+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e641a7280 con 0x7f6e64106f10 2024-09-10T07:48:20.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.814+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e641032c0 con 0x7f6e64106f10 2024-09-10T07:48:20.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.815+0000 7f6e5a7fc640 1 -- 172.21.15.73:0/2148280564 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6e5c005560 con 0x7f6e64106f10 2024-09-10T07:48:20.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.815+0000 7f6e5a7fc640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e500a2c10 0x7f6e500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:20.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.816+0000 7f6e69101640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e500a2c10 0x7f6e500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:20.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.816+0000 7f6e5a7fc640 1 -- 172.21.15.73:0/2148280564 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f6e5c0cf320 con 0x7f6e64106f10 2024-09-10T07:48:20.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.816+0000 7f6e69101640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e500a2c10 0x7f6e500a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6e60005fd0 tx=0x7f6e6000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:20.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.820+0000 7f6e5a7fc640 1 -- 172.21.15.73:0/2148280564 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e5c016030 con 0x7f6e64106f10 2024-09-10T07:48:20.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.991+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6e6410a0f0 con 0x7f6e64106f10 2024-09-10T07:48:20.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.991+0000 7f6e5a7fc640 1 -- 172.21.15.73:0/2148280564 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6e5c09bab0 con 0x7f6e64106f10 2024-09-10T07:48:20.991 INFO:teuthology.orchestra.run.smithi073.stdout:201863462955 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e500a2c10 msgr2=0x7f6e500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e500a2c10 0x7f6e500a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6e60005fd0 tx=0x7f6e6000b390 comp rx=0 tx=0).stop 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64106f10 msgr2=0x7f6e6419efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64106f10 0x7f6e6419efd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00eaa0 tx=0x7f6e5c00ef60 comp rx=0 tx=0).stop 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 shutdown_connections 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6e500a2c10 0x7f6e500a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e64106f10 0x7f6e6419efd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e64102790 0x7f6e6419ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 --2- 172.21.15.73:0/2148280564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e64101de0 0x7f6e6419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:20.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.993+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 >> 172.21.15.73:0/2148280564 conn(0x7f6e640fd8e0 msgr2=0x7f6e640febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:20.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.994+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 shutdown_connections 2024-09-10T07:48:20.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:20.994+0000 7f6e6b365640 1 -- 172.21.15.73:0/2148280564 wait complete. 2024-09-10T07:48:21.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986231 got 133143986234 for osd.4 2024-09-10T07:48:21.753 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:21.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:21 smithi073 ceph-mon[30850]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:21.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:21 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1093021251' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T07:48:21.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:21 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2148280564' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T07:48:22.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:21 smithi102 ceph-mon[35514]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:22.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:21 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1093021251' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T07:48:22.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:21 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2148280564' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T07:48:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:21 smithi159 ceph-mon[35522]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:21 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1093021251' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T07:48:22.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:21 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2148280564' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T07:48:22.165 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462955 for osd.7 2024-09-10T07:48:22.165 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:22.223 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:22.223 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:22.228 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:22.229 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:22.233 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:23.123 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:23.123 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:23.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.404+0000 7f0e41332640 1 -- 172.21.15.73:0/3733232050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c100ca0 msgr2=0x7f0e3c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.404+0000 7f0e41332640 1 --2- 172.21.15.73:0/3733232050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c100ca0 0x7f0e3c1067e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009900 tx=0x7f0e2402a410 comp rx=0 tx=0).stop 2024-09-10T07:48:23.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.404+0000 7f0e41332640 1 -- 172.21.15.73:0/3733232050 shutdown_connections 2024-09-10T07:48:23.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.404+0000 7f0e41332640 1 --2- 172.21.15.73:0/3733232050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e3c106f10 0x7f0e3c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.404+0000 7f0e41332640 1 --2- 172.21.15.73:0/3733232050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c100ca0 0x7f0e3c1067e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.404+0000 7f0e41332640 1 --2- 172.21.15.73:0/3733232050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e3c1002f0 0x7f0e3c1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.404+0000 7f0e41332640 1 -- 172.21.15.73:0/3733232050 >> 172.21.15.73:0/3733232050 conn(0x7f0e3c0fbee0 msgr2=0x7f0e3c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:23.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.404+0000 7f0e41332640 1 -- 172.21.15.73:0/3733232050 shutdown_connections 2024-09-10T07:48:23.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.404+0000 7f0e41332640 1 -- 172.21.15.73:0/3733232050 wait complete. 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e41332640 1 Processor -- start 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e41332640 1 -- start start 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e41332640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c1002f0 0x7f0e3c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e41332640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e3c100ca0 0x7f0e3c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e41332640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e3c106f10 0x7f0e3c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e41332640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c112010 con 0x7f0e3c1002f0 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e41332640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c111e90 con 0x7f0e3c100ca0 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e41332640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c112190 con 0x7f0e3c106f10 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e3affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c1002f0 0x7f0e3c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e3affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c1002f0 0x7f0e3c198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59038/0 (socket says 172.21.15.73:59038) 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.405+0000 7f0e3affd640 1 -- 172.21.15.73:0/3607422797 learned_addr learned my addr 172.21.15.73:0/3607422797 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e3a7fc640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e3c100ca0 0x7f0e3c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e3affd640 1 -- 172.21.15.73:0/3607422797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e3c106f10 msgr2=0x7f0e3c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e3b7fe640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e3c106f10 0x7f0e3c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e3affd640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e3c106f10 0x7f0e3c19ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e3affd640 1 -- 172.21.15.73:0/3607422797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e3c100ca0 msgr2=0x7f0e3c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e3affd640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e3c100ca0 0x7f0e3c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e3affd640 1 -- 172.21.15.73:0/3607422797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3c19d530 con 0x7f0e3c1002f0 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e3a7fc640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e3c100ca0 0x7f0e3c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e3affd640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c1002f0 0x7f0e3c198580 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00b4a0 tx=0x7f0e2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e33fff640 1 -- 172.21.15.73:0/3607422797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c014070 con 0x7f0e3c1002f0 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3c19d820 con 0x7f0e3c1002f0 2024-09-10T07:48:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e33fff640 1 -- 172.21.15.73:0/3607422797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e2c010af0 con 0x7f0e3c1002f0 2024-09-10T07:48:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e33fff640 1 -- 172.21.15.73:0/3607422797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c017d10 con 0x7f0e3c1002f0 2024-09-10T07:48:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.406+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3c1a5100 con 0x7f0e3c1002f0 2024-09-10T07:48:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.407+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e3c100750 con 0x7f0e3c1002f0 2024-09-10T07:48:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.408+0000 7f0e33fff640 1 -- 172.21.15.73:0/3607422797 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0e2c017070 con 0x7f0e3c1002f0 2024-09-10T07:48:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.409+0000 7f0e33fff640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0e280a2c10 0x7f0e280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.409+0000 7f0e3a7fc640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0e280a2c10 0x7f0e280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.409+0000 7f0e33fff640 1 -- 172.21.15.73:0/3607422797 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f0e2c0ce560 con 0x7f0e3c1002f0 2024-09-10T07:48:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.409+0000 7f0e3a7fc640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0e280a2c10 0x7f0e280a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e24000c00 tx=0x7f0e24032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.413+0000 7f0e33fff640 1 -- 172.21.15.73:0/3607422797 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e2c09b450 con 0x7f0e3c1002f0 2024-09-10T07:48:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.589+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0e3c1998e0 con 0x7f0e3c1002f0 2024-09-10T07:48:23.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.589+0000 7f0e33fff640 1 -- 172.21.15.73:0/3607422797 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e2c09ad50 con 0x7f0e3c1002f0 2024-09-10T07:48:23.589 INFO:teuthology.orchestra.run.smithi073.stdout:77309411395 2024-09-10T07:48:23.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.591+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0e280a2c10 msgr2=0x7f0e280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0e280a2c10 0x7f0e280a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e24000c00 tx=0x7f0e24032d50 comp rx=0 tx=0).stop 2024-09-10T07:48:23.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c1002f0 msgr2=0x7f0e3c198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c1002f0 0x7f0e3c198580 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00b4a0 tx=0x7f0e2c00b960 comp rx=0 tx=0).stop 2024-09-10T07:48:23.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 shutdown_connections 2024-09-10T07:48:23.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f0e280a2c10 0x7f0e280a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e3c106f10 0x7f0e3c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e3c100ca0 0x7f0e3c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 --2- 172.21.15.73:0/3607422797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c1002f0 0x7f0e3c198580 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 >> 172.21.15.73:0/3607422797 conn(0x7f0e3c0fbee0 msgr2=0x7f0e3c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:23.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 shutdown_connections 2024-09-10T07:48:23.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.592+0000 7f0e41332640 1 -- 172.21.15.73:0/3607422797 wait complete. 2024-09-10T07:48:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.642+0000 7ff213c3d640 1 -- 172.21.15.73:0/3657325732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c101df0 msgr2=0x7ff20c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.642+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3657325732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c101df0 0x7ff20c1021d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009ca0 tx=0x7ff1fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.643+0000 7ff213c3d640 1 -- 172.21.15.73:0/3657325732 shutdown_connections 2024-09-10T07:48:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.643+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3657325732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff20c106f20 0x7ff20c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.643+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3657325732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff20c1027a0 0x7ff20c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.643+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3657325732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c101df0 0x7ff20c1021d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.643+0000 7ff213c3d640 1 -- 172.21.15.73:0/3657325732 >> 172.21.15.73:0/3657325732 conn(0x7ff20c0fd8f0 msgr2=0x7ff20c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.643+0000 7ff213c3d640 1 -- 172.21.15.73:0/3657325732 shutdown_connections 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.643+0000 7ff213c3d640 1 -- 172.21.15.73:0/3657325732 wait complete. 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.643+0000 7ff213c3d640 1 Processor -- start 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.643+0000 7ff213c3d640 1 -- start start 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff213c3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff20c101df0 0x7ff20c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff213c3d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c1027a0 0x7ff20c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff213c3d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff20c106f20 0x7ff20c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff213c3d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c111fa0 con 0x7ff20c1027a0 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff213c3d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c111e20 con 0x7ff20c106f20 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff213c3d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c112120 con 0x7ff20c101df0 2024-09-10T07:48:23.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2111d8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c1027a0 0x7ff20c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2111d8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c1027a0 0x7ff20c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59056/0 (socket says 172.21.15.73:59056) 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2111d8640 1 -- 172.21.15.73:0/3840532277 learned_addr learned my addr 172.21.15.73:0/3840532277 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2119d9640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff20c101df0 0x7ff20c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2121da640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff20c106f20 0x7ff20c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2111d8640 1 -- 172.21.15.73:0/3840532277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff20c101df0 msgr2=0x7ff20c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2111d8640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff20c101df0 0x7ff20c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2111d8640 1 -- 172.21.15.73:0/3840532277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff20c106f20 msgr2=0x7ff20c19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2111d8640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff20c106f20 0x7ff20c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2111d8640 1 -- 172.21.15.73:0/3840532277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20c19d3f0 con 0x7ff20c1027a0 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2119d9640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff20c101df0 0x7ff20c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff2111d8640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c1027a0 0x7ff20c198980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff20000c920 tx=0x7ff20000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:23.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff20affd640 1 -- 172.21.15.73:0/3840532277 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200007c70 con 0x7ff20c1027a0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff20affd640 1 -- 172.21.15.73:0/3840532277 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff200007e10 con 0x7ff20c1027a0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff20affd640 1 -- 172.21.15.73:0/3840532277 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200018890 con 0x7ff20c1027a0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff20c19d6e0 con 0x7ff20c1027a0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.644+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff20c1a4fc0 con 0x7ff20c1027a0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.645+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff20c1021d0 con 0x7ff20c1027a0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.647+0000 7ff20affd640 1 -- 172.21.15.73:0/3840532277 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff200018a50 con 0x7ff20c1027a0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.647+0000 7ff20affd640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1f40a2c10 0x7ff1f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.647+0000 7ff2119d9640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1f40a2c10 0x7ff1f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.647+0000 7ff20affd640 1 -- 172.21.15.73:0/3840532277 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7ff2000cf690 con 0x7ff20c1027a0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.648+0000 7ff2119d9640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1f40a2c10 0x7ff1f40a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc02f540 tx=0x7ff1fc0099a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:23.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.650+0000 7ff20affd640 1 -- 172.21.15.73:0/3840532277 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff200014030 con 0x7ff20c1027a0 2024-09-10T07:48:23.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.824+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff20c1997a0 con 0x7ff20c1027a0 2024-09-10T07:48:23.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.824+0000 7ff20affd640 1 -- 172.21.15.73:0/3840532277 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff20c1997a0 con 0x7ff20c1027a0 2024-09-10T07:48:23.824 INFO:teuthology.orchestra.run.smithi073.stdout:34359738446 2024-09-10T07:48:23.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1f40a2c10 msgr2=0x7ff1f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1f40a2c10 0x7ff1f40a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc02f540 tx=0x7ff1fc0099a0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c1027a0 msgr2=0x7ff20c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:23.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c1027a0 0x7ff20c198980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff20000c920 tx=0x7ff20000cde0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 shutdown_connections 2024-09-10T07:48:23.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ff1f40a2c10 0x7ff1f40a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff20c106f20 0x7ff20c19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff20c1027a0 0x7ff20c198980 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 --2- 172.21.15.73:0/3840532277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff20c101df0 0x7ff20c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:23.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 >> 172.21.15.73:0/3840532277 conn(0x7ff20c0fd8f0 msgr2=0x7ff20c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:23.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 shutdown_connections 2024-09-10T07:48:23.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:23.826+0000 7ff213c3d640 1 -- 172.21.15.73:0/3840532277 wait complete. 2024-09-10T07:48:23.914 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:23 smithi073 ceph-mon[30850]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:23.915 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:23 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3607422797' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T07:48:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:23 smithi102 ceph-mon[35514]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:24.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:23 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3607422797' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T07:48:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:23 smithi159 ceph-mon[35522]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:23 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3607422797' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T07:48:24.317 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:24.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.740+0000 7ffbf22ff640 1 -- 172.21.15.73:0/548665398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101df0 msgr2=0x7ffbec105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:24.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.740+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/548665398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101df0 0x7ffbec105920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009900 tx=0x7ffbe002a410 comp rx=0 tx=0).stop 2024-09-10T07:48:24.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.740+0000 7ffbf22ff640 1 -- 172.21.15.73:0/548665398 shutdown_connections 2024-09-10T07:48:24.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.740+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/548665398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec106050 0x7ffbec10dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.740+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/548665398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101df0 0x7ffbec105920 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.740+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/548665398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbec101440 0x7ffbec101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.740+0000 7ffbf22ff640 1 -- 172.21.15.73:0/548665398 >> 172.21.15.73:0/548665398 conn(0x7ffbec077210 msgr2=0x7ffbec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:24.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.740+0000 7ffbf22ff640 1 -- 172.21.15.73:0/548665398 shutdown_connections 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.740+0000 7ffbf22ff640 1 -- 172.21.15.73:0/548665398 wait complete. 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbf22ff640 1 Processor -- start 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbf22ff640 1 -- start start 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbf22ff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101440 0x7ffbec197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbf22ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec101df0 0x7ffbec197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbf22ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbec106050 0x7ffbec19be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbf22ff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec1110d0 con 0x7ffbec101440 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbf22ff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec110f50 con 0x7ffbec106050 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbf22ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec111250 con 0x7ffbec101df0 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101440 0x7ffbec197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101440 0x7ffbec197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59070/0 (socket says 172.21.15.73:59070) 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbebfff640 1 -- 172.21.15.73:0/2838641598 learned_addr learned my addr 172.21.15.73:0/2838641598 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbf089c640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbec106050 0x7ffbec19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.741+0000 7ffbeb7fe640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec101df0 0x7ffbec197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:24.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbebfff640 1 -- 172.21.15.73:0/2838641598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec101df0 msgr2=0x7ffbec197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbebfff640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec101df0 0x7ffbec197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbebfff640 1 -- 172.21.15.73:0/2838641598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbec106050 msgr2=0x7ffbec19be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbebfff640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbec106050 0x7ffbec19be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbebfff640 1 -- 172.21.15.73:0/2838641598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec19c500 con 0x7ffbec101440 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbebfff640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101440 0x7ffbec197550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00b4a0 tx=0x7ffbdc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbe97fa640 1 -- 172.21.15.73:0/2838641598 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc014070 con 0x7ffbec101440 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbe97fa640 1 -- 172.21.15.73:0/2838641598 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbdc010af0 con 0x7ffbec101440 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec19c7f0 con 0x7ffbec101440 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbe97fa640 1 -- 172.21.15.73:0/2838641598 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc017d10 con 0x7ffbec101440 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.742+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec1a40d0 con 0x7ffbec101440 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.743+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbec101820 con 0x7ffbec101440 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.744+0000 7ffbe97fa640 1 -- 172.21.15.73:0/2838641598 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffbdc017070 con 0x7ffbec101440 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.745+0000 7ffbe97fa640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffbd40a2c10 0x7ffbd40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.745+0000 7ffbeb7fe640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffbd40a2c10 0x7ffbd40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:24.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.745+0000 7ffbe97fa640 1 -- 172.21.15.73:0/2838641598 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7ffbdc0ce400 con 0x7ffbec101440 2024-09-10T07:48:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.745+0000 7ffbeb7fe640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffbd40a2c10 0x7ffbd40a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0000c00 tx=0x7ffbe00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.749+0000 7ffbe97fa640 1 -- 172.21.15.73:0/2838641598 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffbdc09aca0 con 0x7ffbec101440 2024-09-10T07:48:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.918+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ffbec06a5a0 con 0x7ffbec101440 2024-09-10T07:48:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.919+0000 7ffbe97fa640 1 -- 172.21.15.73:0/2838641598 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffbdc09efa0 con 0x7ffbec101440 2024-09-10T07:48:24.918 INFO:teuthology.orchestra.run.smithi073.stdout:55834574920 2024-09-10T07:48:24.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffbd40a2c10 msgr2=0x7ffbd40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:24.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffbd40a2c10 0x7ffbd40a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0000c00 tx=0x7ffbe00058d0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101440 msgr2=0x7ffbec197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:24.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101440 0x7ffbec197550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00b4a0 tx=0x7ffbdc00b960 comp rx=0 tx=0).stop 2024-09-10T07:48:24.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 shutdown_connections 2024-09-10T07:48:24.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7ffbd40a2c10 0x7ffbd40a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbec106050 0x7ffbec19be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec101df0 0x7ffbec197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 --2- 172.21.15.73:0/2838641598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbec101440 0x7ffbec197550 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:24.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 >> 172.21.15.73:0/2838641598 conn(0x7ffbec077210 msgr2=0x7ffbec104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:24.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 shutdown_connections 2024-09-10T07:48:24.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:24.921+0000 7ffbf22ff640 1 -- 172.21.15.73:0/2838641598 wait complete. 2024-09-10T07:48:25.050 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:24 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3840532277' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T07:48:25.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.050+0000 7f3694619640 1 -- 172.21.15.73:0/2822558445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 msgr2=0x7f368c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:25.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.050+0000 7f3694619640 1 --2- 172.21.15.73:0/2822558445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 0x7f368c1067f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f367c009900 tx=0x7f367c02a410 comp rx=0 tx=0).stop 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 -- 172.21.15.73:0/2822558445 shutdown_connections 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 --2- 172.21.15.73:0/2822558445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f368c106f20 0x7f368c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 --2- 172.21.15.73:0/2822558445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 0x7f368c1067f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 --2- 172.21.15.73:0/2822558445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f368c101df0 0x7f368c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 -- 172.21.15.73:0/2822558445 >> 172.21.15.73:0/2822558445 conn(0x7f368c0fd8f0 msgr2=0x7f368c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 -- 172.21.15.73:0/2822558445 shutdown_connections 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 -- 172.21.15.73:0/2822558445 wait complete. 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 Processor -- start 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 -- start start 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.051+0000 7f3694619640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f368c101df0 0x7f368c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3694619640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 0x7f368c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3694619640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f368c106f20 0x7f368c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:25.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3694619640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f368c111fa0 con 0x7f368c1027a0 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3694619640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f368c111e20 con 0x7f368c106f20 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3694619640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f368c112120 con 0x7f368c101df0 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3691bb4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 0x7f368c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3691bb4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 0x7f368c1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59082/0 (socket says 172.21.15.73:59082) 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3691bb4640 1 -- 172.21.15.73:0/4111265404 learned_addr learned my addr 172.21.15.73:0/4111265404 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3692bb6640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f368c106f20 0x7f368c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f36923b5640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f368c101df0 0x7f368c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3691bb4640 1 -- 172.21.15.73:0/4111265404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f368c101df0 msgr2=0x7f368c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3691bb4640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f368c101df0 0x7f368c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3691bb4640 1 -- 172.21.15.73:0/4111265404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f368c106f20 msgr2=0x7f368c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3691bb4640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f368c106f20 0x7f368c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3691bb4640 1 -- 172.21.15.73:0/4111265404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c19d430 con 0x7f368c1027a0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3691bb4640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 0x7f368c1989c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f367c005ab0 tx=0x7f367c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f36837fe640 1 -- 172.21.15.73:0/4111265404 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c03f030 con 0x7f368c1027a0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f36837fe640 1 -- 172.21.15.73:0/4111265404 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f367c003ce0 con 0x7f368c1027a0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f368c19d6c0 con 0x7f368c1027a0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f36837fe640 1 -- 172.21.15.73:0/4111265404 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c035070 con 0x7f368c1027a0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.052+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f368c1a5000 con 0x7f368c1027a0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.053+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368c1021d0 con 0x7f368c1027a0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.055+0000 7f36837fe640 1 -- 172.21.15.73:0/4111265404 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f367c042030 con 0x7f368c1027a0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.055+0000 7f36837fe640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36780a2c90 0x7f36780a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.056+0000 7f36923b5640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36780a2c90 0x7f36780a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.056+0000 7f36837fe640 1 -- 172.21.15.73:0/4111265404 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f367c0efd60 con 0x7f368c1027a0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.056+0000 7f36923b5640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36780a2c90 0x7f36780a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3688009890 tx=0x7f3688008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:25.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.059+0000 7f36837fe640 1 -- 172.21.15.73:0/4111265404 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f367c0bcb40 con 0x7f368c1027a0 2024-09-10T07:48:25.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:24 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3840532277' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T07:48:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:24 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3840532277' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T07:48:25.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.232+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f368c10a100 con 0x7f368c1027a0 2024-09-10T07:48:25.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.233+0000 7f36837fe640 1 -- 172.21.15.73:0/4111265404 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f367c0bc440 con 0x7f368c1027a0 2024-09-10T07:48:25.232 INFO:teuthology.orchestra.run.smithi073.stdout:231928234023 2024-09-10T07:48:25.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36780a2c90 msgr2=0x7f36780a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36780a2c90 0x7f36780a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3688009890 tx=0x7f3688008040 comp rx=0 tx=0).stop 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 msgr2=0x7f368c1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 0x7f368c1989c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f367c005ab0 tx=0x7f367c0042f0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 shutdown_connections 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f36780a2c90 0x7f36780a5150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f368c106f20 0x7f368c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f368c1027a0 0x7f368c1989c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 --2- 172.21.15.73:0/4111265404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f368c101df0 0x7f368c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 >> 172.21.15.73:0/4111265404 conn(0x7f368c0fd8f0 msgr2=0x7f368c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 shutdown_connections 2024-09-10T07:48:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:25.235+0000 7f3694619640 1 -- 172.21.15.73:0/4111265404 wait complete. 2024-09-10T07:48:25.918 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:25 smithi073 ceph-mon[30850]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:25.918 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:25 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2838641598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T07:48:25.918 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:25 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4111265404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T07:48:25.949 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234021 got 231928234023 for osd.8 2024-09-10T07:48:25.949 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:26.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:25 smithi102 ceph-mon[35514]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:26.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:25 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2838641598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T07:48:26.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:25 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/4111265404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T07:48:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:25 smithi159 ceph-mon[35522]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:25 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2838641598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T07:48:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:25 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/4111265404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T07:48:26.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.385+0000 7f24d27d9640 1 -- 172.21.15.73:0/2228706720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 msgr2=0x7f24cc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.385+0000 7f24d27d9640 1 --2- 172.21.15.73:0/2228706720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 0x7f24cc107b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009930 tx=0x7f24c002a420 comp rx=0 tx=0).stop 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.385+0000 7f24d27d9640 1 -- 172.21.15.73:0/2228706720 shutdown_connections 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.385+0000 7f24d27d9640 1 --2- 172.21.15.73:0/2228706720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24cc1082a0 0x7f24cc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.385+0000 7f24d27d9640 1 --2- 172.21.15.73:0/2228706720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 0x7f24cc107b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.385+0000 7f24d27d9640 1 --2- 172.21.15.73:0/2228706720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24cc102d30 0x7f24cc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.385+0000 7f24d27d9640 1 -- 172.21.15.73:0/2228706720 >> 172.21.15.73:0/2228706720 conn(0x7f24cc0fc7d0 msgr2=0x7f24cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.385+0000 7f24d27d9640 1 -- 172.21.15.73:0/2228706720 shutdown_connections 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.385+0000 7f24d27d9640 1 -- 172.21.15.73:0/2228706720 wait complete. 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24d27d9640 1 Processor -- start 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24d27d9640 1 -- start start 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24d27d9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24cc102d30 0x7f24cc1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:26.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24d27d9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 0x7f24cc198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24d27d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24cc1082a0 0x7f24cc19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24d27d9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc1120c0 con 0x7f24cc1036e0 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24d27d9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc111f40 con 0x7f24cc1082a0 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24d27d9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc112240 con 0x7f24cc102d30 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24cb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 0x7f24cc198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24cb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 0x7f24cc198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59090/0 (socket says 172.21.15.73:59090) 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24cb7fe640 1 -- 172.21.15.73:0/4149318862 learned_addr learned my addr 172.21.15.73:0/4149318862 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.386+0000 7f24cbfff640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24cc102d30 0x7f24cc1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24d0d76640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24cc1082a0 0x7f24cc19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24cb7fe640 1 -- 172.21.15.73:0/4149318862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24cc102d30 msgr2=0x7f24cc1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24cb7fe640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24cc102d30 0x7f24cc1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24cb7fe640 1 -- 172.21.15.73:0/4149318862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24cc1082a0 msgr2=0x7f24cc19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24cb7fe640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24cc1082a0 0x7f24cc19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24cb7fe640 1 -- 172.21.15.73:0/4149318862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24cc19d570 con 0x7f24cc1036e0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24cb7fe640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 0x7f24cc198b00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f24c0005940 tx=0x7f24c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24c97fa640 1 -- 172.21.15.73:0/4149318862 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c003f030 con 0x7f24cc1036e0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24c97fa640 1 -- 172.21.15.73:0/4149318862 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24c0003ce0 con 0x7f24cc1036e0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24cc19d800 con 0x7f24cc1036e0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24c97fa640 1 -- 172.21.15.73:0/4149318862 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0035070 con 0x7f24cc1036e0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.387+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24cc1a5140 con 0x7f24cc1036e0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.388+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24cc06a850 con 0x7f24cc1036e0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.389+0000 7f24c97fa640 1 -- 172.21.15.73:0/4149318862 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f24c0042030 con 0x7f24cc1036e0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.390+0000 7f24c97fa640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f24b40a2c10 0x7f24b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.390+0000 7f24cbfff640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f24b40a2c10 0x7f24b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:26.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.390+0000 7f24c97fa640 1 -- 172.21.15.73:0/4149318862 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f24c00efac0 con 0x7f24cc1036e0 2024-09-10T07:48:26.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.391+0000 7f24cbfff640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f24b40a2c10 0x7f24b40a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009990 tx=0x7f24bc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:26.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.394+0000 7f24c97fa640 1 -- 172.21.15.73:0/4149318862 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24c00bc840 con 0x7f24cc1036e0 2024-09-10T07:48:26.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.565+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f24cc10a2b0 con 0x7f24cc1036e0 2024-09-10T07:48:26.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.566+0000 7f24c97fa640 1 -- 172.21.15.73:0/4149318862 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f24c00bc140 con 0x7f24cc1036e0 2024-09-10T07:48:26.565 INFO:teuthology.orchestra.run.smithi073.stdout:266287972386 2024-09-10T07:48:26.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f24b40a2c10 msgr2=0x7f24b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:26.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f24b40a2c10 0x7f24b40a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009990 tx=0x7f24bc009110 comp rx=0 tx=0).stop 2024-09-10T07:48:26.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 msgr2=0x7f24cc198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:26.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 0x7f24cc198b00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f24c0005940 tx=0x7f24c00042f0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 shutdown_connections 2024-09-10T07:48:26.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f24b40a2c10 0x7f24b40a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24cc1082a0 0x7f24cc19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1036e0 0x7f24cc198b00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 --2- 172.21.15.73:0/4149318862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24cc102d30 0x7f24cc1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:26.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 >> 172.21.15.73:0/4149318862 conn(0x7f24cc0fc7d0 msgr2=0x7f24cc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:26.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 shutdown_connections 2024-09-10T07:48:26.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:26.568+0000 7f24d27d9640 1 -- 172.21.15.73:0/4149318862 wait complete. 2024-09-10T07:48:26.803 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574920 for osd.1 2024-09-10T07:48:26.804 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:27.044 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:26 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4149318862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T07:48:27.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:26 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/4149318862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T07:48:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:26 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/4149318862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T07:48:27.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.304+0000 7f7f179e0640 1 -- 172.21.15.73:0/3448505269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10100e20 msgr2=0x7f7f10101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:27.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.304+0000 7f7f179e0640 1 --2- 172.21.15.73:0/3448505269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10100e20 0x7f7f10101200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009900 tx=0x7f7f0c02a480 comp rx=0 tx=0).stop 2024-09-10T07:48:27.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.304+0000 7f7f179e0640 1 -- 172.21.15.73:0/3448505269 shutdown_connections 2024-09-10T07:48:27.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.304+0000 7f7f179e0640 1 --2- 172.21.15.73:0/3448505269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f10102ef0 0x7f7f1010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.304+0000 7f7f179e0640 1 --2- 172.21.15.73:0/3448505269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f10102570 0x7f7f101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.304+0000 7f7f179e0640 1 --2- 172.21.15.73:0/3448505269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10100e20 0x7f7f10101200 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.304+0000 7f7f179e0640 1 -- 172.21.15.73:0/3448505269 >> 172.21.15.73:0/3448505269 conn(0x7f7f100fc7d0 msgr2=0x7f7f100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:27.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.304+0000 7f7f179e0640 1 -- 172.21.15.73:0/3448505269 shutdown_connections 2024-09-10T07:48:27.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.304+0000 7f7f179e0640 1 -- 172.21.15.73:0/3448505269 wait complete. 2024-09-10T07:48:27.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f179e0640 1 Processor -- start 2024-09-10T07:48:27.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f179e0640 1 -- start start 2024-09-10T07:48:27.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f179e0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f10100e20 0x7f7f10198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:27.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f179e0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f10102570 0x7f7f10198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:27.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f179e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10102ef0 0x7f7f1019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f179e0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7f10110fd0 con 0x7f7f10102ef0 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f179e0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7f10110e50 con 0x7f7f10100e20 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f179e0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7f10111150 con 0x7f7f10102570 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f15f7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10102ef0 0x7f7f1019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f15f7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10102ef0 0x7f7f1019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59104/0 (socket says 172.21.15.73:59104) 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f15f7d640 1 -- 172.21.15.73:0/2830300795 learned_addr learned my addr 172.21.15.73:0/2830300795 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f1577c640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f10100e20 0x7f7f10198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.305+0000 7f7f14f7b640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f10102570 0x7f7f10198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f15f7d640 1 -- 172.21.15.73:0/2830300795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f10102570 msgr2=0x7f7f10198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f15f7d640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f10102570 0x7f7f10198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f15f7d640 1 -- 172.21.15.73:0/2830300795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f10100e20 msgr2=0x7f7f10198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f15f7d640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f10100e20 0x7f7f10198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f15f7d640 1 -- 172.21.15.73:0/2830300795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1019d530 con 0x7f7f10102ef0 2024-09-10T07:48:27.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f14f7b640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f10102570 0x7f7f10198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:27.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f15f7d640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10102ef0 0x7f7f1019ce50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800eaa0 tx=0x7f7f0800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:27.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f067fc640 1 -- 172.21.15.73:0/2830300795 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800cdb0 con 0x7f7f10102ef0 2024-09-10T07:48:27.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1019d820 con 0x7f7f10102ef0 2024-09-10T07:48:27.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f067fc640 1 -- 172.21.15.73:0/2830300795 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f08005020 con 0x7f7f10102ef0 2024-09-10T07:48:27.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f067fc640 1 -- 172.21.15.73:0/2830300795 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f080116b0 con 0x7f7f10102ef0 2024-09-10T07:48:27.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.306+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f101a5100 con 0x7f7f10102ef0 2024-09-10T07:48:27.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.307+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f10101200 con 0x7f7f10102ef0 2024-09-10T07:48:27.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.308+0000 7f7f067fc640 1 -- 172.21.15.73:0/2830300795 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7f08005560 con 0x7f7f10102ef0 2024-09-10T07:48:27.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.309+0000 7f7f067fc640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7efc0a2c10 0x7f7efc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:27.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.309+0000 7f7f1577c640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7efc0a2c10 0x7f7efc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:27.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.309+0000 7f7f067fc640 1 -- 172.21.15.73:0/2830300795 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f7f080cf7a0 con 0x7f7f10102ef0 2024-09-10T07:48:27.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.310+0000 7f7f1577c640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7efc0a2c10 0x7f7efc0a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c000c00 tx=0x7f7f0c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:27.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.313+0000 7f7f067fc640 1 -- 172.21.15.73:0/2830300795 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f08016030 con 0x7f7f10102ef0 2024-09-10T07:48:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.489+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7f1010a0a0 con 0x7f7f10102ef0 2024-09-10T07:48:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.489+0000 7f7f067fc640 1 -- 172.21.15.73:0/2830300795 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7f0809c580 con 0x7f7f10102ef0 2024-09-10T07:48:27.489 INFO:teuthology.orchestra.run.smithi073.stdout:184683593777 2024-09-10T07:48:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7efc0a2c10 msgr2=0x7f7efc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7efc0a2c10 0x7f7efc0a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c000c00 tx=0x7f7f0c005b50 comp rx=0 tx=0).stop 2024-09-10T07:48:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10102ef0 msgr2=0x7f7f1019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10102ef0 0x7f7f1019ce50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800eaa0 tx=0x7f7f0800ef60 comp rx=0 tx=0).stop 2024-09-10T07:48:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 shutdown_connections 2024-09-10T07:48:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f7efc0a2c10 0x7f7efc0a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f10102ef0 0x7f7f1019ce50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f10102570 0x7f7f10198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 --2- 172.21.15.73:0/2830300795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f10100e20 0x7f7f10198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 >> 172.21.15.73:0/2830300795 conn(0x7f7f100fc7d0 msgr2=0x7f7f1006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 shutdown_connections 2024-09-10T07:48:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.492+0000 7f7f179e0640 1 -- 172.21.15.73:0/2830300795 wait complete. 2024-09-10T07:48:27.861 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738446 for osd.0 2024-09-10T07:48:27.861 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:27.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:27 smithi073 ceph-mon[30850]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:48:27.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:27 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:48:27.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:27 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2830300795' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T07:48:27.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:27 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1664683412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T07:48:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 -- 172.21.15.73:0/1062855055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac101420 msgr2=0x7f35ac10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/1062855055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac101420 0x7f35ac10d950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009cd0 tx=0x7f35a402a8e0 comp rx=0 tx=0).stop 2024-09-10T07:48:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 -- 172.21.15.73:0/1062855055 shutdown_connections 2024-09-10T07:48:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/1062855055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac101420 0x7f35ac10d950 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:28.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/1062855055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35ac100a80 0x7f35ac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:28.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/1062855055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac106a80 0x7f35ac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:28.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 -- 172.21.15.73:0/1062855055 >> 172.21.15.73:0/1062855055 conn(0x7f35ac0fc7a0 msgr2=0x7f35ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:28.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 -- 172.21.15.73:0/1062855055 shutdown_connections 2024-09-10T07:48:28.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 -- 172.21.15.73:0/1062855055 wait complete. 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.000+0000 7f35b2bb2640 1 Processor -- start 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b2bb2640 1 -- start start 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b2bb2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac100a80 0x7f35ac1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b2bb2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35ac101420 0x7f35ac197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b2bb2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac106a80 0x7f35ac197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b2bb2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac110e80 con 0x7f35ac100a80 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b2bb2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac110d00 con 0x7f35ac106a80 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b2bb2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac111000 con 0x7f35ac101420 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b094e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac100a80 0x7f35ac1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b094e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac100a80 0x7f35ac1970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59144/0 (socket says 172.21.15.73:59144) 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b094e640 1 -- 172.21.15.73:0/3750070870 learned_addr learned my addr 172.21.15.73:0/3750070870 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b114f640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac106a80 0x7f35ac197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35abfff640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35ac101420 0x7f35ac197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b094e640 1 -- 172.21.15.73:0/3750070870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35ac101420 msgr2=0x7f35ac197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b094e640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35ac101420 0x7f35ac197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b094e640 1 -- 172.21.15.73:0/3750070870 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac106a80 msgr2=0x7f35ac197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b094e640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac106a80 0x7f35ac197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b094e640 1 -- 172.21.15.73:0/3750070870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac1a6950 con 0x7f35ac100a80 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.001+0000 7f35b094e640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac100a80 0x7f35ac1970e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f35a000d950 tx=0x7f35a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.002+0000 7f35a9ffb640 1 -- 172.21.15.73:0/3750070870 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0017030 con 0x7f35ac100a80 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.002+0000 7f35a9ffb640 1 -- 172.21.15.73:0/3750070870 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35a0004020 con 0x7f35ac100a80 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.002+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac1a6c40 con 0x7f35ac100a80 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.002+0000 7f35a9ffb640 1 -- 172.21.15.73:0/3750070870 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a00047a0 con 0x7f35ac100a80 2024-09-10T07:48:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.002+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ac1a7180 con 0x7f35ac100a80 2024-09-10T07:48:28.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.003+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ac1021c0 con 0x7f35ac100a80 2024-09-10T07:48:28.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.004+0000 7f35a9ffb640 1 -- 172.21.15.73:0/3750070870 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f35a00041d0 con 0x7f35ac100a80 2024-09-10T07:48:28.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.005+0000 7f35a9ffb640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f359c0a2af0 0x7f359c0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:28.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.005+0000 7f35abfff640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f359c0a2af0 0x7f359c0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:28.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.005+0000 7f35a9ffb640 1 -- 172.21.15.73:0/3750070870 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f35a00ce480 con 0x7f35ac100a80 2024-09-10T07:48:28.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.005+0000 7f35abfff640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f359c0a2af0 0x7f359c0a4fb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f35ac199240 tx=0x7f359800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:28.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.009+0000 7f35a9ffb640 1 -- 172.21.15.73:0/3750070870 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35a009b260 con 0x7f35ac100a80 2024-09-10T07:48:28.036 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:27 smithi102 ceph-mon[35514]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:48:28.037 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:27 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:48:28.037 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:27 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2830300795' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T07:48:28.037 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:27 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1664683412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T07:48:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:27 smithi159 ceph-mon[35522]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:48:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:27 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:48:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:27 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2830300795' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T07:48:28.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:27 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1664683412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T07:48:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.178+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f35ac109010 con 0x7f35ac100a80 2024-09-10T07:48:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.178+0000 7f35a9ffb640 1 -- 172.21.15.73:0/3750070870 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f35a009ab60 con 0x7f35ac100a80 2024-09-10T07:48:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:287762808860 2024-09-10T07:48:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f359c0a2af0 msgr2=0x7f359c0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f359c0a2af0 0x7f359c0a4fb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f35ac199240 tx=0x7f359800b390 comp rx=0 tx=0).stop 2024-09-10T07:48:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac100a80 msgr2=0x7f35ac1970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac100a80 0x7f35ac1970e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f35a000d950 tx=0x7f35a000de10 comp rx=0 tx=0).stop 2024-09-10T07:48:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 shutdown_connections 2024-09-10T07:48:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f359c0a2af0 0x7f359c0a4fb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac106a80 0x7f35ac197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35ac101420 0x7f35ac197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 --2- 172.21.15.73:0/3750070870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac100a80 0x7f35ac1970e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 >> 172.21.15.73:0/3750070870 conn(0x7f35ac0fc7a0 msgr2=0x7f35ac0fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 shutdown_connections 2024-09-10T07:48:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:28.181+0000 7f35b2bb2640 1 -- 172.21.15.73:0/3750070870 wait complete. 2024-09-10T07:48:28.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411393 got 77309411395 for osd.2 2024-09-10T07:48:28.418 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:29.028 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:28 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3750070870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T07:48:29.028 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.029 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.029 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.029 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:28 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.054 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808858 got 287762808860 for osd.10 2024-09-10T07:48:29.055 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:28 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3750070870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T07:48:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:28 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:28 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3750070870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T07:48:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:28 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:29.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.498+0000 7f965bc7d640 1 -- 172.21.15.73:0/2607780343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 msgr2=0x7f9654103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:29.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.498+0000 7f965bc7d640 1 --2- 172.21.15.73:0/2607780343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 0x7f9654103110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9650009900 tx=0x7f965002a480 comp rx=0 tx=0).stop 2024-09-10T07:48:29.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.498+0000 7f965bc7d640 1 -- 172.21.15.73:0/2607780343 shutdown_connections 2024-09-10T07:48:29.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.498+0000 7f965bc7d640 1 --2- 172.21.15.73:0/2607780343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965410c160 0x7f965410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.498+0000 7f965bc7d640 1 --2- 172.21.15.73:0/2607780343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9654103650 0x7f965410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.498+0000 7f965bc7d640 1 --2- 172.21.15.73:0/2607780343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 0x7f9654103110 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.498+0000 7f965bc7d640 1 -- 172.21.15.73:0/2607780343 >> 172.21.15.73:0/2607780343 conn(0x7f96540fc790 msgr2=0x7f96540febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.499+0000 7f965bc7d640 1 -- 172.21.15.73:0/2607780343 shutdown_connections 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.499+0000 7f965bc7d640 1 -- 172.21.15.73:0/2607780343 wait complete. 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.499+0000 7f965bc7d640 1 Processor -- start 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.499+0000 7f965bc7d640 1 -- start start 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f965bc7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 0x7f9654100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f965bc7d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9654103650 0x7f9654100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f965bc7d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965410c160 0x7f9654101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f965bc7d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9654111f60 con 0x7f9654102d30 2024-09-10T07:48:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f965bc7d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9654111de0 con 0x7f9654103650 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f965bc7d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f96541120e0 con 0x7f965410c160 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659a19640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 0x7f9654100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659a19640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 0x7f9654100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59120/0 (socket says 172.21.15.73:59120) 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659a19640 1 -- 172.21.15.73:0/1664683412 learned_addr learned my addr 172.21.15.73:0/1664683412 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f965a21a640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965410c160 0x7f9654101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659218640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9654103650 0x7f9654100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659a19640 1 -- 172.21.15.73:0/1664683412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965410c160 msgr2=0x7f9654101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659a19640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965410c160 0x7f9654101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659a19640 1 -- 172.21.15.73:0/1664683412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9654103650 msgr2=0x7f9654100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659a19640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9654103650 0x7f9654100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659a19640 1 -- 172.21.15.73:0/1664683412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96541a6970 con 0x7f9654102d30 2024-09-10T07:48:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.500+0000 7f9659a19640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 0x7f9654100990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9650006010 tx=0x7f96500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.501+0000 7f964affd640 1 -- 172.21.15.73:0/1664683412 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965003f030 con 0x7f9654102d30 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.501+0000 7f964affd640 1 -- 172.21.15.73:0/1664683412 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9650003ce0 con 0x7f9654102d30 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.501+0000 7f964affd640 1 -- 172.21.15.73:0/1664683412 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650035070 con 0x7f9654102d30 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.501+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96541a6c00 con 0x7f9654102d30 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.501+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96541a70e0 con 0x7f9654102d30 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.502+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9654103110 con 0x7f9654102d30 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.503+0000 7f964affd640 1 -- 172.21.15.73:0/1664683412 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9650042030 con 0x7f9654102d30 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.504+0000 7f964affd640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96400a2c10 0x7f96400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.504+0000 7f9659218640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96400a2c10 0x7f96400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.504+0000 7f964affd640 1 -- 172.21.15.73:0/1664683412 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f96500ef900 con 0x7f9654102d30 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.504+0000 7f9659218640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96400a2c10 0x7f96400a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9654102420 tx=0x7f964400b360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.507+0000 7f964affd640 1 -- 172.21.15.73:0/1664683412 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96500bc150 con 0x7f9654102d30 2024-09-10T07:48:29.325 INFO:teuthology.orchestra.run.smithi073.stdout:103079215168 2024-09-10T07:48:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.682+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9654107200 con 0x7f9654102d30 2024-09-10T07:48:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.683+0000 7f964affd640 1 -- 172.21.15.73:0/1664683412 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f96500c0450 con 0x7f9654102d30 2024-09-10T07:48:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96400a2c10 msgr2=0x7f96400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96400a2c10 0x7f96400a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9654102420 tx=0x7f964400b360 comp rx=0 tx=0).stop 2024-09-10T07:48:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 msgr2=0x7f9654100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 0x7f9654100990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9650006010 tx=0x7f96500042f0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 shutdown_connections 2024-09-10T07:48:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f96400a2c10 0x7f96400a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965410c160 0x7f9654101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9654103650 0x7f9654100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 --2- 172.21.15.73:0/1664683412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9654102d30 0x7f9654100990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 >> 172.21.15.73:0/1664683412 conn(0x7f96540fc790 msgr2=0x7f96540fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 shutdown_connections 2024-09-10T07:48:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:27.685+0000 7f965bc7d640 1 -- 172.21.15.73:0/1664683412 wait complete. 2024-09-10T07:48:29.960 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:29 smithi073 ceph-mon[30850]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:29.993 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215165 got 103079215168 for osd.3 2024-09-10T07:48:29.993 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:30.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:29 smithi102 ceph-mon[35514]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:30.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:29 smithi159 ceph-mon[35522]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:30.604 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972383 got 266287972386 for osd.9 2024-09-10T07:48:30.604 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:31.091 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593773 got 184683593777 for osd.6 2024-09-10T07:48:31.091 DEBUG:teuthology.parallel:result is None 2024-09-10T07:48:31.091 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T07:48:31.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T07:48:31.925 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:32.049 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:31 smithi073 ceph-mon[30850]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:32.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:31 smithi102 ceph-mon[35514]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:32.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:31 smithi159 ceph-mon[35522]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 -- 172.21.15.73:0/2072344731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102ef0 msgr2=0x7f81fc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 --2- 172.21.15.73:0/2072344731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102ef0 0x7f81fc10da40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009900 tx=0x7f81ec02a480 comp rx=0 tx=0).stop 2024-09-10T07:48:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 -- 172.21.15.73:0/2072344731 shutdown_connections 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 --2- 172.21.15.73:0/2072344731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102ef0 0x7f81fc10da40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 --2- 172.21.15.73:0/2072344731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81fc102570 0x7f81fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 --2- 172.21.15.73:0/2072344731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc100e20 0x7f81fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 -- 172.21.15.73:0/2072344731 >> 172.21.15.73:0/2072344731 conn(0x7f81fc0fc7d0 msgr2=0x7f81fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 -- 172.21.15.73:0/2072344731 shutdown_connections 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 -- 172.21.15.73:0/2072344731 wait complete. 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 Processor -- start 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.413+0000 7f820133a640 1 -- start start 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f820133a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc100e20 0x7f81fc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f820133a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102570 0x7f81fc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f820133a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81fc102ef0 0x7f81fc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f820133a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc110fa0 con 0x7f81fc102570 2024-09-10T07:48:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f820133a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc110e20 con 0x7f81fc100e20 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f820133a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc111120 con 0x7f81fc102ef0 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102570 0x7f81fc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102570 0x7f81fc198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58892/0 (socket says 172.21.15.73:58892) 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fa7fc640 1 -- 172.21.15.73:0/3554566089 learned_addr learned my addr 172.21.15.73:0/3554566089 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fb7fe640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81fc102ef0 0x7f81fc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fa7fc640 1 -- 172.21.15.73:0/3554566089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81fc102ef0 msgr2=0x7f81fc19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fa7fc640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81fc102ef0 0x7f81fc19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81faffd640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc100e20 0x7f81fc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fa7fc640 1 -- 172.21.15.73:0/3554566089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc100e20 msgr2=0x7f81fc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fa7fc640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc100e20 0x7f81fc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fa7fc640 1 -- 172.21.15.73:0/3554566089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc19d400 con 0x7f81fc102570 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81faffd640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc100e20 0x7f81fc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81fa7fc640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102570 0x7f81fc198990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f81e400c920 tx=0x7f81e400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81f3fff640 1 -- 172.21.15.73:0/3554566089 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4007c70 con 0x7f81fc102570 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc19d6f0 con 0x7f81fc102570 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81f3fff640 1 -- 172.21.15.73:0/3554566089 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e4007e10 con 0x7f81fc102570 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f81f3fff640 1 -- 172.21.15.73:0/3554566089 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4018890 con 0x7f81fc102570 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.414+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc1a4fd0 con 0x7f81fc102570 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.415+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81fc101200 con 0x7f81fc102570 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.416+0000 7f81f3fff640 1 -- 172.21.15.73:0/3554566089 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f81e4018a70 con 0x7f81fc102570 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.417+0000 7f81f3fff640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f81e80a2c10 0x7f81e80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.417+0000 7f81faffd640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f81e80a2c10 0x7f81e80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.417+0000 7f81f3fff640 1 -- 172.21.15.73:0/3554566089 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f81e40cf3f0 con 0x7f81fc102570 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.418+0000 7f81faffd640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f81e80a2c10 0x7f81e80a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007eb0 tx=0x7f81f40073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.421+0000 7f81f3fff640 1 -- 172.21.15.73:0/3554566089 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81e4014030 con 0x7f81fc102570 2024-09-10T07:48:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.628+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81fc10a0d0 con 0x7f81e80a2c10 2024-09-10T07:48:32.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.638+0000 7f81f3fff640 1 -- 172.21.15.73:0/3554566089 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258642 (secure 0 0 0) 0x7f81fc10a0d0 con 0x7f81e80a2c10 2024-09-10T07:48:32.640 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:32.642 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-10T07:48:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f81e80a2c10 msgr2=0x7f81e80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f81e80a2c10 0x7f81e80a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007eb0 tx=0x7f81f40073c0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102570 msgr2=0x7f81fc198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102570 0x7f81fc198990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f81e400c920 tx=0x7f81e400cde0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 shutdown_connections 2024-09-10T07:48:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f81e80a2c10 0x7f81e80a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81fc102ef0 0x7f81fc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81fc102570 0x7f81fc198990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 --2- 172.21.15.73:0/3554566089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc100e20 0x7f81fc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 >> 172.21.15.73:0/3554566089 conn(0x7f81fc0fc7d0 msgr2=0x7f81fc06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 shutdown_connections 2024-09-10T07:48:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:32.641+0000 7f820133a640 1 -- 172.21.15.73:0/3554566089 wait complete. 2024-09-10T07:48:33.326 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-10T07:48:30.673400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":244,"num_read_kb":235,"num_write":266,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353600,"kb_used_data":12648,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588224,"statfs":{"total":1151940427776,"available":1151578341376,"internally_reserved":0,"allocated":12951552,"data_stored":7262409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003023"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174321+0000","last_change":"2024-09-10T07:47:31.876663+0000","last_active":"2024-09-10T07:47:46.174321+0000","last_peered":"2024-09-10T07:47:46.174321+0000","last_clean":"2024-09-10T07:47:46.174321+0000","last_became_active":"2024-09-10T07:47:31.876368+0000","last_became_peered":"2024-09-10T07:47:31.876368+0000","last_unstale":"2024-09-10T07:47:46.174321+0000","last_undegraded":"2024-09-10T07:47:46.174321+0000","last_fullsized":"2024-09-10T07:47:46.174321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:30.203753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176341+0000","last_change":"2024-09-10T07:47:31.867862+0000","last_active":"2024-09-10T07:47:46.176341+0000","last_peered":"2024-09-10T07:47:46.176341+0000","last_clean":"2024-09-10T07:47:46.176341+0000","last_became_active":"2024-09-10T07:47:31.867553+0000","last_became_peered":"2024-09-10T07:47:31.867553+0000","last_unstale":"2024-09-10T07:47:46.176341+0000","last_undegraded":"2024-09-10T07:47:46.176341+0000","last_fullsized":"2024-09-10T07:47:46.176341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:02.809443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176241+0000","last_change":"2024-09-10T07:47:31.873697+0000","last_active":"2024-09-10T07:47:46.176241+0000","last_peered":"2024-09-10T07:47:46.176241+0000","last_clean":"2024-09-10T07:47:46.176241+0000","last_became_active":"2024-09-10T07:47:31.873156+0000","last_became_peered":"2024-09-10T07:47:31.873156+0000","last_unstale":"2024-09-10T07:47:46.176241+0000","last_undegraded":"2024-09-10T07:47:46.176241+0000","last_fullsized":"2024-09-10T07:47:46.176241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:16.365317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192901+0000","last_change":"2024-09-10T07:47:31.869749+0000","last_active":"2024-09-10T07:47:46.192901+0000","last_peered":"2024-09-10T07:47:46.192901+0000","last_clean":"2024-09-10T07:47:46.192901+0000","last_became_active":"2024-09-10T07:47:31.868474+0000","last_became_peered":"2024-09-10T07:47:31.868474+0000","last_unstale":"2024-09-10T07:47:46.192901+0000","last_undegraded":"2024-09-10T07:47:46.192901+0000","last_fullsized":"2024-09-10T07:47:46.192901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:49.809017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177905+0000","last_change":"2024-09-10T07:47:31.864160+0000","last_active":"2024-09-10T07:47:46.177905+0000","last_peered":"2024-09-10T07:47:46.177905+0000","last_clean":"2024-09-10T07:47:46.177905+0000","last_became_active":"2024-09-10T07:47:31.862214+0000","last_became_peered":"2024-09-10T07:47:31.862214+0000","last_unstale":"2024-09-10T07:47:46.177905+0000","last_undegraded":"2024-09-10T07:47:46.177905+0000","last_fullsized":"2024-09-10T07:47:46.177905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:50.422218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.194241+0000","last_change":"2024-09-10T07:47:46.194241+0000","last_active":"2024-09-10T07:47:46.194241+0000","last_peered":"2024-09-10T07:47:46.194241+0000","last_clean":"2024-09-10T07:47:46.194241+0000","last_became_active":"2024-09-10T07:47:46.193667+0000","last_became_peered":"2024-09-10T07:47:46.193667+0000","last_unstale":"2024-09-10T07:47:46.194241+0000","last_undegraded":"2024-09-10T07:47:46.194241+0000","last_fullsized":"2024-09-10T07:47:46.194241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:05.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.193934+0000","last_change":"2024-09-10T07:47:46.193934+0000","last_active":"2024-09-10T07:47:46.193934+0000","last_peered":"2024-09-10T07:47:46.193934+0000","last_clean":"2024-09-10T07:47:46.193934+0000","last_became_active":"2024-09-10T07:47:46.193474+0000","last_became_peered":"2024-09-10T07:47:46.193474+0000","last_unstale":"2024-09-10T07:47:46.193934+0000","last_undegraded":"2024-09-10T07:47:46.193934+0000","last_fullsized":"2024-09-10T07:47:46.193934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:00.465345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171799+0000","last_change":"2024-09-10T07:47:31.871924+0000","last_active":"2024-09-10T07:47:46.171799+0000","last_peered":"2024-09-10T07:47:46.171799+0000","last_clean":"2024-09-10T07:47:46.171799+0000","last_became_active":"2024-09-10T07:47:31.871639+0000","last_became_peered":"2024-09-10T07:47:31.871639+0000","last_unstale":"2024-09-10T07:47:46.171799+0000","last_undegraded":"2024-09-10T07:47:46.171799+0000","last_fullsized":"2024-09-10T07:47:46.171799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:48.248506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173438+0000","last_change":"2024-09-10T07:47:31.876528+0000","last_active":"2024-09-10T07:47:46.173438+0000","last_peered":"2024-09-10T07:47:46.173438+0000","last_clean":"2024-09-10T07:47:46.173438+0000","last_became_active":"2024-09-10T07:47:31.876022+0000","last_became_peered":"2024-09-10T07:47:31.876022+0000","last_unstale":"2024-09-10T07:47:46.173438+0000","last_undegraded":"2024-09-10T07:47:46.173438+0000","last_fullsized":"2024-09-10T07:47:46.173438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:07.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177291+0000","last_change":"2024-09-10T07:47:31.864740+0000","last_active":"2024-09-10T07:47:46.177291+0000","last_peered":"2024-09-10T07:47:46.177291+0000","last_clean":"2024-09-10T07:47:46.177291+0000","last_became_active":"2024-09-10T07:47:31.864138+0000","last_became_peered":"2024-09-10T07:47:31.864138+0000","last_unstale":"2024-09-10T07:47:46.177291+0000","last_undegraded":"2024-09-10T07:47:46.177291+0000","last_fullsized":"2024-09-10T07:47:46.177291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:27.248169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174342+0000","last_change":"2024-09-10T07:47:31.875751+0000","last_active":"2024-09-10T07:47:46.174342+0000","last_peered":"2024-09-10T07:47:46.174342+0000","last_clean":"2024-09-10T07:47:46.174342+0000","last_became_active":"2024-09-10T07:47:31.875399+0000","last_became_peered":"2024-09-10T07:47:31.875399+0000","last_unstale":"2024-09-10T07:47:46.174342+0000","last_undegraded":"2024-09-10T07:47:46.174342+0000","last_fullsized":"2024-09-10T07:47:46.174342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:19.439947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192991+0000","last_change":"2024-09-10T07:47:31.870220+0000","last_active":"2024-09-10T07:47:46.192991+0000","last_peered":"2024-09-10T07:47:46.192991+0000","last_clean":"2024-09-10T07:47:46.192991+0000","last_became_active":"2024-09-10T07:47:31.869018+0000","last_became_peered":"2024-09-10T07:47:31.869018+0000","last_unstale":"2024-09-10T07:47:46.192991+0000","last_undegraded":"2024-09-10T07:47:46.192991+0000","last_fullsized":"2024-09-10T07:47:46.192991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:52.108972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192766+0000","last_change":"2024-09-10T07:47:31.868419+0000","last_active":"2024-09-10T07:47:46.192766+0000","last_peered":"2024-09-10T07:47:46.192766+0000","last_clean":"2024-09-10T07:47:46.192766+0000","last_became_active":"2024-09-10T07:47:31.868093+0000","last_became_peered":"2024-09-10T07:47:31.868093+0000","last_unstale":"2024-09-10T07:47:46.192766+0000","last_undegraded":"2024-09-10T07:47:46.192766+0000","last_fullsized":"2024-09-10T07:47:46.192766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:24.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176134+0000","last_change":"2024-09-10T07:47:31.866974+0000","last_active":"2024-09-10T07:47:46.176134+0000","last_peered":"2024-09-10T07:47:46.176134+0000","last_clean":"2024-09-10T07:47:46.176134+0000","last_became_active":"2024-09-10T07:47:31.866579+0000","last_became_peered":"2024-09-10T07:47:31.866579+0000","last_unstale":"2024-09-10T07:47:46.176134+0000","last_undegraded":"2024-09-10T07:47:46.176134+0000","last_fullsized":"2024-09-10T07:47:46.176134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:47.140259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.180225+0000","last_change":"2024-09-10T07:47:46.180225+0000","last_active":"2024-09-10T07:47:46.180225+0000","last_peered":"2024-09-10T07:47:46.180225+0000","last_clean":"2024-09-10T07:47:46.180225+0000","last_became_active":"2024-09-10T07:47:46.179885+0000","last_became_peered":"2024-09-10T07:47:46.179885+0000","last_unstale":"2024-09-10T07:47:46.180225+0000","last_undegraded":"2024-09-10T07:47:46.180225+0000","last_fullsized":"2024-09-10T07:47:46.180225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:00.796740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172587+0000","last_change":"2024-09-10T07:47:31.876926+0000","last_active":"2024-09-10T07:47:46.172587+0000","last_peered":"2024-09-10T07:47:46.172587+0000","last_clean":"2024-09-10T07:47:46.172587+0000","last_became_active":"2024-09-10T07:47:31.876620+0000","last_became_peered":"2024-09-10T07:47:31.876620+0000","last_unstale":"2024-09-10T07:47:46.172587+0000","last_undegraded":"2024-09-10T07:47:46.172587+0000","last_fullsized":"2024-09-10T07:47:46.172587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:53.863927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174354+0000","last_change":"2024-09-10T07:47:31.871088+0000","last_active":"2024-09-10T07:47:46.174354+0000","last_peered":"2024-09-10T07:47:46.174354+0000","last_clean":"2024-09-10T07:47:46.174354+0000","last_became_active":"2024-09-10T07:47:31.870709+0000","last_became_peered":"2024-09-10T07:47:31.870709+0000","last_unstale":"2024-09-10T07:47:46.174354+0000","last_undegraded":"2024-09-10T07:47:46.174354+0000","last_fullsized":"2024-09-10T07:47:46.174354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:34.964229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174874+0000","last_change":"2024-09-10T07:47:31.869310+0000","last_active":"2024-09-10T07:47:46.174874+0000","last_peered":"2024-09-10T07:47:46.174874+0000","last_clean":"2024-09-10T07:47:46.174874+0000","last_became_active":"2024-09-10T07:47:31.868892+0000","last_became_peered":"2024-09-10T07:47:31.868892+0000","last_unstale":"2024-09-10T07:47:46.174874+0000","last_undegraded":"2024-09-10T07:47:46.174874+0000","last_fullsized":"2024-09-10T07:47:46.174874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:15.338010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177118+0000","last_change":"2024-09-10T07:47:31.867938+0000","last_active":"2024-09-10T07:47:46.177118+0000","last_peered":"2024-09-10T07:47:46.177118+0000","last_clean":"2024-09-10T07:47:46.177118+0000","last_became_active":"2024-09-10T07:47:31.867556+0000","last_became_peered":"2024-09-10T07:47:31.867556+0000","last_unstale":"2024-09-10T07:47:46.177118+0000","last_undegraded":"2024-09-10T07:47:46.177118+0000","last_fullsized":"2024-09-10T07:47:46.177118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:43.198241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173966+0000","last_change":"2024-09-10T07:47:31.864157+0000","last_active":"2024-09-10T07:47:46.173966+0000","last_peered":"2024-09-10T07:47:46.173966+0000","last_clean":"2024-09-10T07:47:46.173966+0000","last_became_active":"2024-09-10T07:47:31.863802+0000","last_became_peered":"2024-09-10T07:47:31.863802+0000","last_unstale":"2024-09-10T07:47:46.173966+0000","last_undegraded":"2024-09-10T07:47:46.173966+0000","last_fullsized":"2024-09-10T07:47:46.173966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:03.492869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192857+0000","last_change":"2024-09-10T07:47:31.865404+0000","last_active":"2024-09-10T07:47:46.192857+0000","last_peered":"2024-09-10T07:47:46.192857+0000","last_clean":"2024-09-10T07:47:46.192857+0000","last_became_active":"2024-09-10T07:47:31.865098+0000","last_became_peered":"2024-09-10T07:47:31.865098+0000","last_unstale":"2024-09-10T07:47:46.192857+0000","last_undegraded":"2024-09-10T07:47:46.192857+0000","last_fullsized":"2024-09-10T07:47:46.192857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:56.111270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172776+0000","last_change":"2024-09-10T07:47:31.869880+0000","last_active":"2024-09-10T07:47:46.172776+0000","last_peered":"2024-09-10T07:47:46.172776+0000","last_clean":"2024-09-10T07:47:46.172776+0000","last_became_active":"2024-09-10T07:47:31.869535+0000","last_became_peered":"2024-09-10T07:47:31.869535+0000","last_unstale":"2024-09-10T07:47:46.172776+0000","last_undegraded":"2024-09-10T07:47:46.172776+0000","last_fullsized":"2024-09-10T07:47:46.172776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:53.157821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171861+0000","last_change":"2024-09-10T07:47:31.867799+0000","last_active":"2024-09-10T07:47:46.171861+0000","last_peered":"2024-09-10T07:47:46.171861+0000","last_clean":"2024-09-10T07:47:46.171861+0000","last_became_active":"2024-09-10T07:47:31.867499+0000","last_became_peered":"2024-09-10T07:47:31.867499+0000","last_unstale":"2024-09-10T07:47:46.171861+0000","last_undegraded":"2024-09-10T07:47:46.171861+0000","last_fullsized":"2024-09-10T07:47:46.171861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:47.340340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177625+0000","last_change":"2024-09-10T07:47:46.176635+0000","last_active":"2024-09-10T07:47:46.177625+0000","last_peered":"2024-09-10T07:47:46.177625+0000","last_clean":"2024-09-10T07:47:46.177625+0000","last_became_active":"2024-09-10T07:47:46.176225+0000","last_became_peered":"2024-09-10T07:47:46.176225+0000","last_unstale":"2024-09-10T07:47:46.177625+0000","last_undegraded":"2024-09-10T07:47:46.177625+0000","last_fullsized":"2024-09-10T07:47:46.177625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:33.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172991+0000","last_change":"2024-09-10T07:47:31.864776+0000","last_active":"2024-09-10T07:47:46.172991+0000","last_peered":"2024-09-10T07:47:46.172991+0000","last_clean":"2024-09-10T07:47:46.172991+0000","last_became_active":"2024-09-10T07:47:31.864446+0000","last_became_peered":"2024-09-10T07:47:31.864446+0000","last_unstale":"2024-09-10T07:47:46.172991+0000","last_undegraded":"2024-09-10T07:47:46.172991+0000","last_fullsized":"2024-09-10T07:47:46.172991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:38.976206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177130+0000","last_change":"2024-09-10T07:47:31.871688+0000","last_active":"2024-09-10T07:47:46.177130+0000","last_peered":"2024-09-10T07:47:46.177130+0000","last_clean":"2024-09-10T07:47:46.177130+0000","last_became_active":"2024-09-10T07:47:31.871484+0000","last_became_peered":"2024-09-10T07:47:31.871484+0000","last_unstale":"2024-09-10T07:47:46.177130+0000","last_undegraded":"2024-09-10T07:47:46.177130+0000","last_fullsized":"2024-09-10T07:47:46.177130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:53.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174171+0000","last_change":"2024-09-10T07:47:31.868919+0000","last_active":"2024-09-10T07:47:46.174171+0000","last_peered":"2024-09-10T07:47:46.174171+0000","last_clean":"2024-09-10T07:47:46.174171+0000","last_became_active":"2024-09-10T07:47:31.868593+0000","last_became_peered":"2024-09-10T07:47:31.868593+0000","last_unstale":"2024-09-10T07:47:46.174171+0000","last_undegraded":"2024-09-10T07:47:46.174171+0000","last_fullsized":"2024-09-10T07:47:46.174171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:02.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192808+0000","last_change":"2024-09-10T07:47:31.863674+0000","last_active":"2024-09-10T07:47:46.192808+0000","last_peered":"2024-09-10T07:47:46.192808+0000","last_clean":"2024-09-10T07:47:46.192808+0000","last_became_active":"2024-09-10T07:47:31.863347+0000","last_became_peered":"2024-09-10T07:47:31.863347+0000","last_unstale":"2024-09-10T07:47:46.192808+0000","last_undegraded":"2024-09-10T07:47:46.192808+0000","last_fullsized":"2024-09-10T07:47:46.192808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:55.819510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176196+0000","last_change":"2024-09-10T07:47:31.869710+0000","last_active":"2024-09-10T07:47:46.176196+0000","last_peered":"2024-09-10T07:47:46.176196+0000","last_clean":"2024-09-10T07:47:46.176196+0000","last_became_active":"2024-09-10T07:47:31.869284+0000","last_became_peered":"2024-09-10T07:47:31.869284+0000","last_unstale":"2024-09-10T07:47:46.176196+0000","last_undegraded":"2024-09-10T07:47:46.176196+0000","last_fullsized":"2024-09-10T07:47:46.176196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:49.128941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176605+0000","last_change":"2024-09-10T07:47:31.865576+0000","last_active":"2024-09-10T07:47:46.176605+0000","last_peered":"2024-09-10T07:47:46.176605+0000","last_clean":"2024-09-10T07:47:46.176605+0000","last_became_active":"2024-09-10T07:47:31.865225+0000","last_became_peered":"2024-09-10T07:47:31.865225+0000","last_unstale":"2024-09-10T07:47:46.176605+0000","last_undegraded":"2024-09-10T07:47:46.176605+0000","last_fullsized":"2024-09-10T07:47:46.176605+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:10.390091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176806+0000","last_change":"2024-09-10T07:47:31.869155+0000","last_active":"2024-09-10T07:47:46.176806+0000","last_peered":"2024-09-10T07:47:46.176806+0000","last_clean":"2024-09-10T07:47:46.176806+0000","last_became_active":"2024-09-10T07:47:31.868737+0000","last_became_peered":"2024-09-10T07:47:31.868737+0000","last_unstale":"2024-09-10T07:47:46.176806+0000","last_undegraded":"2024-09-10T07:47:46.176806+0000","last_fullsized":"2024-09-10T07:47:46.176806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:16.123687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173764+0000","last_change":"2024-09-10T07:47:31.870079+0000","last_active":"2024-09-10T07:47:46.173764+0000","last_peered":"2024-09-10T07:47:46.173764+0000","last_clean":"2024-09-10T07:47:46.173764+0000","last_became_active":"2024-09-10T07:47:31.869554+0000","last_became_peered":"2024-09-10T07:47:31.869554+0000","last_unstale":"2024-09-10T07:47:46.173764+0000","last_undegraded":"2024-09-10T07:47:46.173764+0000","last_fullsized":"2024-09-10T07:47:46.173764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:54.685962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177344+0000","last_change":"2024-09-10T07:47:31.867605+0000","last_active":"2024-09-10T07:47:46.177344+0000","last_peered":"2024-09-10T07:47:46.177344+0000","last_clean":"2024-09-10T07:47:46.177344+0000","last_became_active":"2024-09-10T07:47:31.867296+0000","last_became_peered":"2024-09-10T07:47:31.867296+0000","last_unstale":"2024-09-10T07:47:46.177344+0000","last_undegraded":"2024-09-10T07:47:46.177344+0000","last_fullsized":"2024-09-10T07:47:46.177344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:59.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172952+0000","last_change":"2024-09-10T07:47:29.862795+0000","last_active":"2024-09-10T07:47:46.172952+0000","last_peered":"2024-09-10T07:47:46.172952+0000","last_clean":"2024-09-10T07:47:46.172952+0000","last_became_active":"2024-09-10T07:47:29.862437+0000","last_became_peered":"2024-09-10T07:47:29.862437+0000","last_unstale":"2024-09-10T07:47:46.172952+0000","last_undegraded":"2024-09-10T07:47:46.172952+0000","last_fullsized":"2024-09-10T07:47:46.172952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:34.233270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172849+0000","last_change":"2024-09-10T07:47:31.868932+0000","last_active":"2024-09-10T07:47:46.172849+0000","last_peered":"2024-09-10T07:47:46.172849+0000","last_clean":"2024-09-10T07:47:46.172849+0000","last_became_active":"2024-09-10T07:47:31.868534+0000","last_became_peered":"2024-09-10T07:47:31.868534+0000","last_unstale":"2024-09-10T07:47:46.172849+0000","last_undegraded":"2024-09-10T07:47:46.172849+0000","last_fullsized":"2024-09-10T07:47:46.172849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:12.164453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177434+0000","last_change":"2024-09-10T07:47:29.858029+0000","last_active":"2024-09-10T07:47:46.177434+0000","last_peered":"2024-09-10T07:47:46.177434+0000","last_clean":"2024-09-10T07:47:46.177434+0000","last_became_active":"2024-09-10T07:47:29.857556+0000","last_became_peered":"2024-09-10T07:47:29.857556+0000","last_unstale":"2024-09-10T07:47:46.177434+0000","last_undegraded":"2024-09-10T07:47:46.177434+0000","last_fullsized":"2024-09-10T07:47:46.177434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:37.831252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192589+0000","last_change":"2024-09-10T07:47:29.856390+0000","last_active":"2024-09-10T07:47:46.192589+0000","last_peered":"2024-09-10T07:47:46.192589+0000","last_clean":"2024-09-10T07:47:46.192589+0000","last_became_active":"2024-09-10T07:47:29.856042+0000","last_became_peered":"2024-09-10T07:47:29.856042+0000","last_unstale":"2024-09-10T07:47:46.192589+0000","last_undegraded":"2024-09-10T07:47:46.192589+0000","last_fullsized":"2024-09-10T07:47:46.192589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:57.934410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171927+0000","last_change":"2024-09-10T07:47:31.863414+0000","last_active":"2024-09-10T07:47:46.171927+0000","last_peered":"2024-09-10T07:47:46.171927+0000","last_clean":"2024-09-10T07:47:46.171927+0000","last_became_active":"2024-09-10T07:47:31.863116+0000","last_became_peered":"2024-09-10T07:47:31.863116+0000","last_unstale":"2024-09-10T07:47:46.171927+0000","last_undegraded":"2024-09-10T07:47:46.171927+0000","last_fullsized":"2024-09-10T07:47:46.171927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:02.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172688+0000","last_change":"2024-09-10T07:47:29.860106+0000","last_active":"2024-09-10T07:47:46.172688+0000","last_peered":"2024-09-10T07:47:46.172688+0000","last_clean":"2024-09-10T07:47:46.172688+0000","last_became_active":"2024-09-10T07:47:29.859700+0000","last_became_peered":"2024-09-10T07:47:29.859700+0000","last_unstale":"2024-09-10T07:47:46.172688+0000","last_undegraded":"2024-09-10T07:47:46.172688+0000","last_fullsized":"2024-09-10T07:47:46.172688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:07.832889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174363+0000","last_change":"2024-09-10T07:47:31.866263+0000","last_active":"2024-09-10T07:47:46.174363+0000","last_peered":"2024-09-10T07:47:46.174363+0000","last_clean":"2024-09-10T07:47:46.174363+0000","last_became_active":"2024-09-10T07:47:31.865911+0000","last_became_peered":"2024-09-10T07:47:31.865911+0000","last_unstale":"2024-09-10T07:47:46.174363+0000","last_undegraded":"2024-09-10T07:47:46.174363+0000","last_fullsized":"2024-09-10T07:47:46.174363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:53.644360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177424+0000","last_change":"2024-09-10T07:47:29.861490+0000","last_active":"2024-09-10T07:47:46.177424+0000","last_peered":"2024-09-10T07:47:46.177424+0000","last_clean":"2024-09-10T07:47:46.177424+0000","last_became_active":"2024-09-10T07:47:29.861042+0000","last_became_peered":"2024-09-10T07:47:29.861042+0000","last_unstale":"2024-09-10T07:47:46.177424+0000","last_undegraded":"2024-09-10T07:47:46.177424+0000","last_fullsized":"2024-09-10T07:47:46.177424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:12.626954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173037+0000","last_change":"2024-09-10T07:47:31.871792+0000","last_active":"2024-09-10T07:47:46.173037+0000","last_peered":"2024-09-10T07:47:46.173037+0000","last_clean":"2024-09-10T07:47:46.173037+0000","last_became_active":"2024-09-10T07:47:31.870859+0000","last_became_peered":"2024-09-10T07:47:31.870859+0000","last_unstale":"2024-09-10T07:47:46.173037+0000","last_undegraded":"2024-09-10T07:47:46.173037+0000","last_fullsized":"2024-09-10T07:47:46.173037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:08.479377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174617+0000","last_change":"2024-09-10T07:47:29.862475+0000","last_active":"2024-09-10T07:47:46.174617+0000","last_peered":"2024-09-10T07:47:46.174617+0000","last_clean":"2024-09-10T07:47:46.174617+0000","last_became_active":"2024-09-10T07:47:29.862094+0000","last_became_peered":"2024-09-10T07:47:29.862094+0000","last_unstale":"2024-09-10T07:47:46.174617+0000","last_undegraded":"2024-09-10T07:47:46.174617+0000","last_fullsized":"2024-09-10T07:47:46.174617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:25.933844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176742+0000","last_change":"2024-09-10T07:47:31.868963+0000","last_active":"2024-09-10T07:47:46.176742+0000","last_peered":"2024-09-10T07:47:46.176742+0000","last_clean":"2024-09-10T07:47:46.176742+0000","last_became_active":"2024-09-10T07:47:31.868650+0000","last_became_peered":"2024-09-10T07:47:31.868650+0000","last_unstale":"2024-09-10T07:47:46.176742+0000","last_undegraded":"2024-09-10T07:47:46.176742+0000","last_fullsized":"2024-09-10T07:47:46.176742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:39.613235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172874+0000","last_change":"2024-09-10T07:47:29.861572+0000","last_active":"2024-09-10T07:47:46.172874+0000","last_peered":"2024-09-10T07:47:46.172874+0000","last_clean":"2024-09-10T07:47:46.172874+0000","last_became_active":"2024-09-10T07:47:29.860710+0000","last_became_peered":"2024-09-10T07:47:29.860710+0000","last_unstale":"2024-09-10T07:47:46.172874+0000","last_undegraded":"2024-09-10T07:47:46.172874+0000","last_fullsized":"2024-09-10T07:47:46.172874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:28.535090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173093+0000","last_change":"2024-09-10T07:47:31.869976+0000","last_active":"2024-09-10T07:47:46.173093+0000","last_peered":"2024-09-10T07:47:46.173093+0000","last_clean":"2024-09-10T07:47:46.173093+0000","last_became_active":"2024-09-10T07:47:31.868678+0000","last_became_peered":"2024-09-10T07:47:31.868678+0000","last_unstale":"2024-09-10T07:47:46.173093+0000","last_undegraded":"2024-09-10T07:47:46.173093+0000","last_fullsized":"2024-09-10T07:47:46.173093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:38.362180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'27","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:48:27.176714+0000","last_change":"2024-09-10T07:47:29.863534+0000","last_active":"2024-09-10T07:48:27.176714+0000","last_peered":"2024-09-10T07:48:27.176714+0000","last_clean":"2024-09-10T07:48:27.176714+0000","last_became_active":"2024-09-10T07:47:29.863136+0000","last_became_peered":"2024-09-10T07:47:29.863136+0000","last_unstale":"2024-09-10T07:48:27.176714+0000","last_undegraded":"2024-09-10T07:48:27.176714+0000","last_fullsized":"2024-09-10T07:48:27.176714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:21.261019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":105,"num_read_kb":113,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178297+0000","last_change":"2024-09-10T07:47:31.866435+0000","last_active":"2024-09-10T07:47:46.178297+0000","last_peered":"2024-09-10T07:47:46.178297+0000","last_clean":"2024-09-10T07:47:46.178297+0000","last_became_active":"2024-09-10T07:47:31.866099+0000","last_became_peered":"2024-09-10T07:47:31.866099+0000","last_unstale":"2024-09-10T07:47:46.178297+0000","last_undegraded":"2024-09-10T07:47:46.178297+0000","last_fullsized":"2024-09-10T07:47:46.178297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177210+0000","last_change":"2024-09-10T07:47:29.862633+0000","last_active":"2024-09-10T07:47:46.177210+0000","last_peered":"2024-09-10T07:47:46.177210+0000","last_clean":"2024-09-10T07:47:46.177210+0000","last_became_active":"2024-09-10T07:47:29.862214+0000","last_became_peered":"2024-09-10T07:47:29.862214+0000","last_unstale":"2024-09-10T07:47:46.177210+0000","last_undegraded":"2024-09-10T07:47:46.177210+0000","last_fullsized":"2024-09-10T07:47:46.177210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:34.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192682+0000","last_change":"2024-09-10T07:47:31.863361+0000","last_active":"2024-09-10T07:47:46.192682+0000","last_peered":"2024-09-10T07:47:46.192682+0000","last_clean":"2024-09-10T07:47:46.192682+0000","last_became_active":"2024-09-10T07:47:31.863048+0000","last_became_peered":"2024-09-10T07:47:31.863048+0000","last_unstale":"2024-09-10T07:47:46.192682+0000","last_undegraded":"2024-09-10T07:47:46.192682+0000","last_fullsized":"2024-09-10T07:47:46.192682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:54.770006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173311+0000","last_change":"2024-09-10T07:47:29.858767+0000","last_active":"2024-09-10T07:47:46.173311+0000","last_peered":"2024-09-10T07:47:46.173311+0000","last_clean":"2024-09-10T07:47:46.173311+0000","last_became_active":"2024-09-10T07:47:29.858419+0000","last_became_peered":"2024-09-10T07:47:29.858419+0000","last_unstale":"2024-09-10T07:47:46.173311+0000","last_undegraded":"2024-09-10T07:47:46.173311+0000","last_fullsized":"2024-09-10T07:47:46.173311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:03.642873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174068+0000","last_change":"2024-09-10T07:47:31.870593+0000","last_active":"2024-09-10T07:47:46.174068+0000","last_peered":"2024-09-10T07:47:46.174068+0000","last_clean":"2024-09-10T07:47:46.174068+0000","last_became_active":"2024-09-10T07:47:31.870285+0000","last_became_peered":"2024-09-10T07:47:31.870285+0000","last_unstale":"2024-09-10T07:47:46.174068+0000","last_undegraded":"2024-09-10T07:47:46.174068+0000","last_fullsized":"2024-09-10T07:47:46.174068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:49.370065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192726+0000","last_change":"2024-09-10T07:47:29.856937+0000","last_active":"2024-09-10T07:47:46.192726+0000","last_peered":"2024-09-10T07:47:46.192726+0000","last_clean":"2024-09-10T07:47:46.192726+0000","last_became_active":"2024-09-10T07:47:29.856559+0000","last_became_peered":"2024-09-10T07:47:29.856559+0000","last_unstale":"2024-09-10T07:47:46.192726+0000","last_undegraded":"2024-09-10T07:47:46.192726+0000","last_fullsized":"2024-09-10T07:47:46.192726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:01.135693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174684+0000","last_change":"2024-09-10T07:47:31.871743+0000","last_active":"2024-09-10T07:47:46.174684+0000","last_peered":"2024-09-10T07:47:46.174684+0000","last_clean":"2024-09-10T07:47:46.174684+0000","last_became_active":"2024-09-10T07:47:31.871395+0000","last_became_peered":"2024-09-10T07:47:31.871395+0000","last_unstale":"2024-09-10T07:47:46.174684+0000","last_undegraded":"2024-09-10T07:47:46.174684+0000","last_fullsized":"2024-09-10T07:47:46.174684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:18.450216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176747+0000","last_change":"2024-09-10T07:47:29.863405+0000","last_active":"2024-09-10T07:47:46.176747+0000","last_peered":"2024-09-10T07:47:46.176747+0000","last_clean":"2024-09-10T07:47:46.176747+0000","last_became_active":"2024-09-10T07:47:29.862832+0000","last_became_peered":"2024-09-10T07:47:29.862832+0000","last_unstale":"2024-09-10T07:47:46.176747+0000","last_undegraded":"2024-09-10T07:47:46.176747+0000","last_fullsized":"2024-09-10T07:47:46.176747+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:10.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173136+0000","last_change":"2024-09-10T07:47:31.872412+0000","last_active":"2024-09-10T07:47:46.173136+0000","last_peered":"2024-09-10T07:47:46.173136+0000","last_clean":"2024-09-10T07:47:46.173136+0000","last_became_active":"2024-09-10T07:47:31.871380+0000","last_became_peered":"2024-09-10T07:47:31.871380+0000","last_unstale":"2024-09-10T07:47:46.173136+0000","last_undegraded":"2024-09-10T07:47:46.173136+0000","last_fullsized":"2024-09-10T07:47:46.173136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:09.730443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178875+0000","last_change":"2024-09-10T07:47:29.861556+0000","last_active":"2024-09-10T07:47:46.178875+0000","last_peered":"2024-09-10T07:47:46.178875+0000","last_clean":"2024-09-10T07:47:46.178875+0000","last_became_active":"2024-09-10T07:47:29.861053+0000","last_became_peered":"2024-09-10T07:47:29.861053+0000","last_unstale":"2024-09-10T07:47:46.178875+0000","last_undegraded":"2024-09-10T07:47:46.178875+0000","last_fullsized":"2024-09-10T07:47:46.178875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:21.969667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174106+0000","last_change":"2024-09-10T07:47:31.868023+0000","last_active":"2024-09-10T07:47:46.174106+0000","last_peered":"2024-09-10T07:47:46.174106+0000","last_clean":"2024-09-10T07:47:46.174106+0000","last_became_active":"2024-09-10T07:47:31.867722+0000","last_became_peered":"2024-09-10T07:47:31.867722+0000","last_unstale":"2024-09-10T07:47:46.174106+0000","last_undegraded":"2024-09-10T07:47:46.174106+0000","last_fullsized":"2024-09-10T07:47:46.174106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:01.399800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192980+0000","last_change":"2024-09-10T07:47:29.862054+0000","last_active":"2024-09-10T07:47:46.192980+0000","last_peered":"2024-09-10T07:47:46.192980+0000","last_clean":"2024-09-10T07:47:46.192980+0000","last_became_active":"2024-09-10T07:47:29.861731+0000","last_became_peered":"2024-09-10T07:47:29.861731+0000","last_unstale":"2024-09-10T07:47:46.192980+0000","last_undegraded":"2024-09-10T07:47:46.192980+0000","last_fullsized":"2024-09-10T07:47:46.192980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:45.043458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174768+0000","last_change":"2024-09-10T07:47:31.871372+0000","last_active":"2024-09-10T07:47:46.174768+0000","last_peered":"2024-09-10T07:47:46.174768+0000","last_clean":"2024-09-10T07:47:46.174768+0000","last_became_active":"2024-09-10T07:47:31.871048+0000","last_became_peered":"2024-09-10T07:47:31.871048+0000","last_unstale":"2024-09-10T07:47:46.174768+0000","last_undegraded":"2024-09-10T07:47:46.174768+0000","last_fullsized":"2024-09-10T07:47:46.174768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:58.934809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172999+0000","last_change":"2024-09-10T07:47:29.861974+0000","last_active":"2024-09-10T07:47:46.172999+0000","last_peered":"2024-09-10T07:47:46.172999+0000","last_clean":"2024-09-10T07:47:46.172999+0000","last_became_active":"2024-09-10T07:47:29.861240+0000","last_became_peered":"2024-09-10T07:47:29.861240+0000","last_unstale":"2024-09-10T07:47:46.172999+0000","last_undegraded":"2024-09-10T07:47:46.172999+0000","last_fullsized":"2024-09-10T07:47:46.172999+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:05.235927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174244+0000","last_change":"2024-09-10T07:47:31.871807+0000","last_active":"2024-09-10T07:47:46.174244+0000","last_peered":"2024-09-10T07:47:46.174244+0000","last_clean":"2024-09-10T07:47:46.174244+0000","last_became_active":"2024-09-10T07:47:31.871489+0000","last_became_peered":"2024-09-10T07:47:31.871489+0000","last_unstale":"2024-09-10T07:47:46.174244+0000","last_undegraded":"2024-09-10T07:47:46.174244+0000","last_fullsized":"2024-09-10T07:47:46.174244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:00.754188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176930+0000","last_change":"2024-09-10T07:47:30.089332+0000","last_active":"2024-09-10T07:47:46.176930+0000","last_peered":"2024-09-10T07:47:46.176930+0000","last_clean":"2024-09-10T07:47:46.176930+0000","last_became_active":"2024-09-10T07:47:30.088879+0000","last_became_peered":"2024-09-10T07:47:30.088879+0000","last_unstale":"2024-09-10T07:47:46.176930+0000","last_undegraded":"2024-09-10T07:47:46.176930+0000","last_fullsized":"2024-09-10T07:47:46.176930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:40.875957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174405+0000","last_change":"2024-09-10T07:47:31.873732+0000","last_active":"2024-09-10T07:47:46.174405+0000","last_peered":"2024-09-10T07:47:46.174405+0000","last_clean":"2024-09-10T07:47:46.174405+0000","last_became_active":"2024-09-10T07:47:31.873291+0000","last_became_peered":"2024-09-10T07:47:31.873291+0000","last_unstale":"2024-09-10T07:47:46.174405+0000","last_undegraded":"2024-09-10T07:47:46.174405+0000","last_fullsized":"2024-09-10T07:47:46.174405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:02.095237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174815+0000","last_change":"2024-09-10T07:46:21.922704+0000","last_active":"2024-09-10T07:47:46.174815+0000","last_peered":"2024-09-10T07:47:46.174815+0000","last_clean":"2024-09-10T07:47:46.174815+0000","last_became_active":"2024-09-10T07:46:21.922144+0000","last_became_peered":"2024-09-10T07:46:21.922144+0000","last_unstale":"2024-09-10T07:47:46.174815+0000","last_undegraded":"2024-09-10T07:47:46.174815+0000","last_fullsized":"2024-09-10T07:47:46.174815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:42:58.927087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:42:58.927087+0000","last_clean_scrub_stamp":"2024-09-10T07:42:58.927087+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:11.355989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192853+0000","last_change":"2024-09-10T07:47:29.859739+0000","last_active":"2024-09-10T07:47:46.192853+0000","last_peered":"2024-09-10T07:47:46.192853+0000","last_clean":"2024-09-10T07:47:46.192853+0000","last_became_active":"2024-09-10T07:47:29.859223+0000","last_became_peered":"2024-09-10T07:47:29.859223+0000","last_unstale":"2024-09-10T07:47:46.192853+0000","last_undegraded":"2024-09-10T07:47:46.192853+0000","last_fullsized":"2024-09-10T07:47:46.192853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:48.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176834+0000","last_change":"2024-09-10T07:47:46.176368+0000","last_active":"2024-09-10T07:47:46.176834+0000","last_peered":"2024-09-10T07:47:46.176834+0000","last_clean":"2024-09-10T07:47:46.176834+0000","last_became_active":"2024-09-10T07:47:46.176008+0000","last_became_peered":"2024-09-10T07:47:46.176008+0000","last_unstale":"2024-09-10T07:47:46.176834+0000","last_undegraded":"2024-09-10T07:47:46.176834+0000","last_fullsized":"2024-09-10T07:47:46.176834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:45.707644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174793+0000","last_change":"2024-09-10T07:47:29.861314+0000","last_active":"2024-09-10T07:47:46.174793+0000","last_peered":"2024-09-10T07:47:46.174793+0000","last_clean":"2024-09-10T07:47:46.174793+0000","last_became_active":"2024-09-10T07:47:29.860946+0000","last_became_peered":"2024-09-10T07:47:29.860946+0000","last_unstale":"2024-09-10T07:47:46.174793+0000","last_undegraded":"2024-09-10T07:47:46.174793+0000","last_fullsized":"2024-09-10T07:47:46.174793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:38.530660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192570+0000","last_change":"2024-09-10T07:47:31.867374+0000","last_active":"2024-09-10T07:47:46.192570+0000","last_peered":"2024-09-10T07:47:46.192570+0000","last_clean":"2024-09-10T07:47:46.192570+0000","last_became_active":"2024-09-10T07:47:31.867065+0000","last_became_peered":"2024-09-10T07:47:31.867065+0000","last_unstale":"2024-09-10T07:47:46.192570+0000","last_undegraded":"2024-09-10T07:47:46.192570+0000","last_fullsized":"2024-09-10T07:47:46.192570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:07.688314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192682+0000","last_change":"2024-09-10T07:47:29.854853+0000","last_active":"2024-09-10T07:47:46.192682+0000","last_peered":"2024-09-10T07:47:46.192682+0000","last_clean":"2024-09-10T07:47:46.192682+0000","last_became_active":"2024-09-10T07:47:29.854553+0000","last_became_peered":"2024-09-10T07:47:29.854553+0000","last_unstale":"2024-09-10T07:47:46.192682+0000","last_undegraded":"2024-09-10T07:47:46.192682+0000","last_fullsized":"2024-09-10T07:47:46.192682+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:34.570076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172538+0000","last_change":"2024-09-10T07:47:31.868522+0000","last_active":"2024-09-10T07:47:46.172538+0000","last_peered":"2024-09-10T07:47:46.172538+0000","last_clean":"2024-09-10T07:47:46.172538+0000","last_became_active":"2024-09-10T07:47:31.868114+0000","last_became_peered":"2024-09-10T07:47:31.868114+0000","last_unstale":"2024-09-10T07:47:46.172538+0000","last_undegraded":"2024-09-10T07:47:46.172538+0000","last_fullsized":"2024-09-10T07:47:46.172538+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.442513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174097+0000","last_change":"2024-09-10T07:47:29.856185+0000","last_active":"2024-09-10T07:47:46.174097+0000","last_peered":"2024-09-10T07:47:46.174097+0000","last_clean":"2024-09-10T07:47:46.174097+0000","last_became_active":"2024-09-10T07:47:29.855809+0000","last_became_peered":"2024-09-10T07:47:29.855809+0000","last_unstale":"2024-09-10T07:47:46.174097+0000","last_undegraded":"2024-09-10T07:47:46.174097+0000","last_fullsized":"2024-09-10T07:47:46.174097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:55.325391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177351+0000","last_change":"2024-09-10T07:47:31.862955+0000","last_active":"2024-09-10T07:47:46.177351+0000","last_peered":"2024-09-10T07:47:46.177351+0000","last_clean":"2024-09-10T07:47:46.177351+0000","last_became_active":"2024-09-10T07:47:31.862671+0000","last_became_peered":"2024-09-10T07:47:31.862671+0000","last_unstale":"2024-09-10T07:47:46.177351+0000","last_undegraded":"2024-09-10T07:47:46.177351+0000","last_fullsized":"2024-09-10T07:47:46.177351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:54.858623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174440+0000","last_change":"2024-09-10T07:47:29.861345+0000","last_active":"2024-09-10T07:47:46.174440+0000","last_peered":"2024-09-10T07:47:46.174440+0000","last_clean":"2024-09-10T07:47:46.174440+0000","last_became_active":"2024-09-10T07:47:29.860987+0000","last_became_peered":"2024-09-10T07:47:29.860987+0000","last_unstale":"2024-09-10T07:47:46.174440+0000","last_undegraded":"2024-09-10T07:47:46.174440+0000","last_fullsized":"2024-09-10T07:47:46.174440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:33.202676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176992+0000","last_change":"2024-09-10T07:47:31.861217+0000","last_active":"2024-09-10T07:47:46.176992+0000","last_peered":"2024-09-10T07:47:46.176992+0000","last_clean":"2024-09-10T07:47:46.176992+0000","last_became_active":"2024-09-10T07:47:31.860572+0000","last_became_peered":"2024-09-10T07:47:31.860572+0000","last_unstale":"2024-09-10T07:47:46.176992+0000","last_undegraded":"2024-09-10T07:47:46.176992+0000","last_fullsized":"2024-09-10T07:47:46.176992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:39.537642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.179624+0000","last_change":"2024-09-10T07:47:29.855256+0000","last_active":"2024-09-10T07:47:46.179624+0000","last_peered":"2024-09-10T07:47:46.179624+0000","last_clean":"2024-09-10T07:47:46.179624+0000","last_became_active":"2024-09-10T07:47:29.854922+0000","last_became_peered":"2024-09-10T07:47:29.854922+0000","last_unstale":"2024-09-10T07:47:46.179624+0000","last_undegraded":"2024-09-10T07:47:46.179624+0000","last_fullsized":"2024-09-10T07:47:46.179624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:44.264077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192868+0000","last_change":"2024-09-10T07:47:31.866057+0000","last_active":"2024-09-10T07:47:46.192868+0000","last_peered":"2024-09-10T07:47:46.192868+0000","last_clean":"2024-09-10T07:47:46.192868+0000","last_became_active":"2024-09-10T07:47:31.865696+0000","last_became_peered":"2024-09-10T07:47:31.865696+0000","last_unstale":"2024-09-10T07:47:46.192868+0000","last_undegraded":"2024-09-10T07:47:46.192868+0000","last_fullsized":"2024-09-10T07:47:46.192868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:31.904881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:54.128173+0000","last_change":"2024-09-10T07:47:29.853800+0000","last_active":"2024-09-10T07:47:54.128173+0000","last_peered":"2024-09-10T07:47:54.128173+0000","last_clean":"2024-09-10T07:47:54.128173+0000","last_became_active":"2024-09-10T07:47:29.853480+0000","last_became_peered":"2024-09-10T07:47:29.853480+0000","last_unstale":"2024-09-10T07:47:54.128173+0000","last_undegraded":"2024-09-10T07:47:54.128173+0000","last_fullsized":"2024-09-10T07:47:54.128173+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:31.683236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173078+0000","last_change":"2024-09-10T07:47:31.864686+0000","last_active":"2024-09-10T07:47:46.173078+0000","last_peered":"2024-09-10T07:47:46.173078+0000","last_clean":"2024-09-10T07:47:46.173078+0000","last_became_active":"2024-09-10T07:47:31.864188+0000","last_became_peered":"2024-09-10T07:47:31.864188+0000","last_unstale":"2024-09-10T07:47:46.173078+0000","last_undegraded":"2024-09-10T07:47:46.173078+0000","last_fullsized":"2024-09-10T07:47:46.173078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:15.838121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.193128+0000","last_change":"2024-09-10T07:47:30.089172+0000","last_active":"2024-09-10T07:47:46.193128+0000","last_peered":"2024-09-10T07:47:46.193128+0000","last_clean":"2024-09-10T07:47:46.193128+0000","last_became_active":"2024-09-10T07:47:30.088859+0000","last_became_peered":"2024-09-10T07:47:30.088859+0000","last_unstale":"2024-09-10T07:47:46.193128+0000","last_undegraded":"2024-09-10T07:47:46.193128+0000","last_fullsized":"2024-09-10T07:47:46.193128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:22.415581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176427+0000","last_change":"2024-09-10T07:47:31.863676+0000","last_active":"2024-09-10T07:47:46.176427+0000","last_peered":"2024-09-10T07:47:46.176427+0000","last_clean":"2024-09-10T07:47:46.176427+0000","last_became_active":"2024-09-10T07:47:31.863399+0000","last_became_peered":"2024-09-10T07:47:31.863399+0000","last_unstale":"2024-09-10T07:47:46.176427+0000","last_undegraded":"2024-09-10T07:47:46.176427+0000","last_fullsized":"2024-09-10T07:47:46.176427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:40.168078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172713+0000","last_change":"2024-09-10T07:47:29.862578+0000","last_active":"2024-09-10T07:47:46.172713+0000","last_peered":"2024-09-10T07:47:46.172713+0000","last_clean":"2024-09-10T07:47:46.172713+0000","last_became_active":"2024-09-10T07:47:29.862157+0000","last_became_peered":"2024-09-10T07:47:29.862157+0000","last_unstale":"2024-09-10T07:47:46.172713+0000","last_undegraded":"2024-09-10T07:47:46.172713+0000","last_fullsized":"2024-09-10T07:47:46.172713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:47.201556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176894+0000","last_change":"2024-09-10T07:47:31.865766+0000","last_active":"2024-09-10T07:47:46.176894+0000","last_peered":"2024-09-10T07:47:46.176894+0000","last_clean":"2024-09-10T07:47:46.176894+0000","last_became_active":"2024-09-10T07:47:31.865416+0000","last_became_peered":"2024-09-10T07:47:31.865416+0000","last_unstale":"2024-09-10T07:47:46.176894+0000","last_undegraded":"2024-09-10T07:47:46.176894+0000","last_fullsized":"2024-09-10T07:47:46.176894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.274836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171982+0000","last_change":"2024-09-10T07:47:29.856768+0000","last_active":"2024-09-10T07:47:46.171982+0000","last_peered":"2024-09-10T07:47:46.171982+0000","last_clean":"2024-09-10T07:47:46.171982+0000","last_became_active":"2024-09-10T07:47:29.856457+0000","last_became_peered":"2024-09-10T07:47:29.856457+0000","last_unstale":"2024-09-10T07:47:46.171982+0000","last_undegraded":"2024-09-10T07:47:46.171982+0000","last_fullsized":"2024-09-10T07:47:46.171982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:17.227156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173830+0000","last_change":"2024-09-10T07:47:31.865457+0000","last_active":"2024-09-10T07:47:46.173830+0000","last_peered":"2024-09-10T07:47:46.173830+0000","last_clean":"2024-09-10T07:47:46.173830+0000","last_became_active":"2024-09-10T07:47:31.864801+0000","last_became_peered":"2024-09-10T07:47:31.864801+0000","last_unstale":"2024-09-10T07:47:46.173830+0000","last_undegraded":"2024-09-10T07:47:46.173830+0000","last_fullsized":"2024-09-10T07:47:46.173830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:59.236321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.182025+0000","last_change":"2024-09-10T07:47:46.180534+0000","last_active":"2024-09-10T07:47:46.182025+0000","last_peered":"2024-09-10T07:47:46.182025+0000","last_clean":"2024-09-10T07:47:46.182025+0000","last_became_active":"2024-09-10T07:47:46.180067+0000","last_became_peered":"2024-09-10T07:47:46.180067+0000","last_unstale":"2024-09-10T07:47:46.182025+0000","last_undegraded":"2024-09-10T07:47:46.182025+0000","last_fullsized":"2024-09-10T07:47:46.182025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:39.221934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172418+0000","last_change":"2024-09-10T07:47:31.864617+0000","last_active":"2024-09-10T07:47:46.172418+0000","last_peered":"2024-09-10T07:47:46.172418+0000","last_clean":"2024-09-10T07:47:46.172418+0000","last_became_active":"2024-09-10T07:47:31.864284+0000","last_became_peered":"2024-09-10T07:47:31.864284+0000","last_unstale":"2024-09-10T07:47:46.172418+0000","last_undegraded":"2024-09-10T07:47:46.172418+0000","last_fullsized":"2024-09-10T07:47:46.172418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:31.406445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.185054+0000","last_change":"2024-09-10T07:47:46.184591+0000","last_active":"2024-09-10T07:47:46.185054+0000","last_peered":"2024-09-10T07:47:46.185054+0000","last_clean":"2024-09-10T07:47:46.185054+0000","last_became_active":"2024-09-10T07:47:46.179474+0000","last_became_peered":"2024-09-10T07:47:46.179474+0000","last_unstale":"2024-09-10T07:47:46.185054+0000","last_undegraded":"2024-09-10T07:47:46.185054+0000","last_fullsized":"2024-09-10T07:47:46.185054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:02.752937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173972+0000","last_change":"2024-09-10T07:47:31.869921+0000","last_active":"2024-09-10T07:47:46.173972+0000","last_peered":"2024-09-10T07:47:46.173972+0000","last_clean":"2024-09-10T07:47:46.173972+0000","last_became_active":"2024-09-10T07:47:31.869602+0000","last_became_peered":"2024-09-10T07:47:31.869602+0000","last_unstale":"2024-09-10T07:47:46.173972+0000","last_undegraded":"2024-09-10T07:47:46.173972+0000","last_fullsized":"2024-09-10T07:47:46.173972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:50.590335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.181800+0000","last_change":"2024-09-10T07:47:46.181800+0000","last_active":"2024-09-10T07:47:46.181800+0000","last_peered":"2024-09-10T07:47:46.181800+0000","last_clean":"2024-09-10T07:47:46.181800+0000","last_became_active":"2024-09-10T07:47:46.181358+0000","last_became_peered":"2024-09-10T07:47:46.181358+0000","last_unstale":"2024-09-10T07:47:46.181800+0000","last_undegraded":"2024-09-10T07:47:46.181800+0000","last_fullsized":"2024-09-10T07:47:46.181800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:23.311525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178303+0000","last_change":"2024-09-10T07:47:29.862301+0000","last_active":"2024-09-10T07:47:46.178303+0000","last_peered":"2024-09-10T07:47:46.178303+0000","last_clean":"2024-09-10T07:47:46.178303+0000","last_became_active":"2024-09-10T07:47:29.861113+0000","last_became_peered":"2024-09-10T07:47:29.861113+0000","last_unstale":"2024-09-10T07:47:46.178303+0000","last_undegraded":"2024-09-10T07:47:46.178303+0000","last_fullsized":"2024-09-10T07:47:46.178303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:14.923430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172699+0000","last_change":"2024-09-10T07:47:31.871097+0000","last_active":"2024-09-10T07:47:46.172699+0000","last_peered":"2024-09-10T07:47:46.172699+0000","last_clean":"2024-09-10T07:47:46.172699+0000","last_became_active":"2024-09-10T07:47:31.869399+0000","last_became_peered":"2024-09-10T07:47:31.869399+0000","last_unstale":"2024-09-10T07:47:46.172699+0000","last_undegraded":"2024-09-10T07:47:46.172699+0000","last_fullsized":"2024-09-10T07:47:46.172699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:07.967838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.186555+0000","last_change":"2024-09-10T07:47:46.186555+0000","last_active":"2024-09-10T07:47:46.186555+0000","last_peered":"2024-09-10T07:47:46.186555+0000","last_clean":"2024-09-10T07:47:46.186555+0000","last_became_active":"2024-09-10T07:47:46.182966+0000","last_became_peered":"2024-09-10T07:47:46.182966+0000","last_unstale":"2024-09-10T07:47:46.186555+0000","last_undegraded":"2024-09-10T07:47:46.186555+0000","last_fullsized":"2024-09-10T07:47:46.186555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:32.435739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176715+0000","last_change":"2024-09-10T07:47:31.873450+0000","last_active":"2024-09-10T07:47:46.176715+0000","last_peered":"2024-09-10T07:47:46.176715+0000","last_clean":"2024-09-10T07:47:46.176715+0000","last_became_active":"2024-09-10T07:47:31.873134+0000","last_became_peered":"2024-09-10T07:47:31.873134+0000","last_unstale":"2024-09-10T07:47:46.176715+0000","last_undegraded":"2024-09-10T07:47:46.176715+0000","last_fullsized":"2024-09-10T07:47:46.176715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:19.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173185+0000","last_change":"2024-09-10T07:47:29.861395+0000","last_active":"2024-09-10T07:47:46.173185+0000","last_peered":"2024-09-10T07:47:46.173185+0000","last_clean":"2024-09-10T07:47:46.173185+0000","last_became_active":"2024-09-10T07:47:29.861002+0000","last_became_peered":"2024-09-10T07:47:29.861002+0000","last_unstale":"2024-09-10T07:47:46.173185+0000","last_undegraded":"2024-09-10T07:47:46.173185+0000","last_fullsized":"2024-09-10T07:47:46.173185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:59.347663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172934+0000","last_change":"2024-09-10T07:47:31.872400+0000","last_active":"2024-09-10T07:47:46.172934+0000","last_peered":"2024-09-10T07:47:46.172934+0000","last_clean":"2024-09-10T07:47:46.172934+0000","last_became_active":"2024-09-10T07:47:31.871995+0000","last_became_peered":"2024-09-10T07:47:31.871995+0000","last_unstale":"2024-09-10T07:47:46.172934+0000","last_undegraded":"2024-09-10T07:47:46.172934+0000","last_fullsized":"2024-09-10T07:47:46.172934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:51.421387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.198560+0000","last_change":"2024-09-10T07:47:46.198560+0000","last_active":"2024-09-10T07:47:46.198560+0000","last_peered":"2024-09-10T07:47:46.198560+0000","last_clean":"2024-09-10T07:47:46.198560+0000","last_became_active":"2024-09-10T07:47:46.194070+0000","last_became_peered":"2024-09-10T07:47:46.194070+0000","last_unstale":"2024-09-10T07:47:46.198560+0000","last_undegraded":"2024-09-10T07:47:46.198560+0000","last_fullsized":"2024-09-10T07:47:46.198560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:03.590728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":108,"num_read_kb":116,"num_write":83,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547225,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":441646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808861,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1589248,"data_stored":1095144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":442228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":441668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1032713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":441763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1032313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":442250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":504499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":504465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":441736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T07:48:33.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T07:48:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:33.941 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:33 smithi073 ceph-mon[30850]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:48:33.942 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:33 smithi073 ceph-mon[30850]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:33.942 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:33.942 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:33.942 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:48:33.942 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:48:33.942 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:33 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.020+0000 7f6b3deae640 1 -- 172.21.15.73:0/2076949187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381036e0 msgr2=0x7f6b38107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.020+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2076949187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381036e0 0x7f6b38107b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009930 tx=0x7f6b2c02a420 comp rx=0 tx=0).stop 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.020+0000 7f6b3deae640 1 -- 172.21.15.73:0/2076949187 shutdown_connections 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.020+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2076949187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b381082a0 0x7f6b3810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.020+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2076949187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381036e0 0x7f6b38107b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.020+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2076949187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102d30 0x7f6b38103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.020+0000 7f6b3deae640 1 -- 172.21.15.73:0/2076949187 >> 172.21.15.73:0/2076949187 conn(0x7f6b380fc7d0 msgr2=0x7f6b380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 -- 172.21.15.73:0/2076949187 shutdown_connections 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 -- 172.21.15.73:0/2076949187 wait complete. 2024-09-10T07:48:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 Processor -- start 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 -- start start 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b38102d30 0x7f6b38100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b381036e0 0x7f6b38100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381082a0 0x7f6b38101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b381120a0 con 0x7f6b381082a0 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b38111f20 con 0x7f6b38102d30 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.021+0000 7f6b3deae640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6b38112220 con 0x7f6b381036e0 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b37fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381082a0 0x7f6b38101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b37fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381082a0 0x7f6b38101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58920/0 (socket says 172.21.15.73:58920) 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b37fff640 1 -- 172.21.15.73:0/2918497606 learned_addr learned my addr 172.21.15.73:0/2918497606 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b36ffd640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b381036e0 0x7f6b38100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b377fe640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b38102d30 0x7f6b38100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b37fff640 1 -- 172.21.15.73:0/2918497606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b381036e0 msgr2=0x7f6b38100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b37fff640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b381036e0 0x7f6b38100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b37fff640 1 -- 172.21.15.73:0/2918497606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b38102d30 msgr2=0x7f6b38100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b37fff640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b38102d30 0x7f6b38100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b37fff640 1 -- 172.21.15.73:0/2918497606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b381a6aa0 con 0x7f6b381082a0 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b37fff640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381082a0 0x7f6b38101410 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c970 tx=0x7f6b3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b34ff9640 1 -- 172.21.15.73:0/2918497606 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30007bb0 con 0x7f6b381082a0 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b381a6d90 con 0x7f6b381082a0 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b34ff9640 1 -- 172.21.15.73:0/2918497606 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b30007d50 con 0x7f6b381082a0 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b34ff9640 1 -- 172.21.15.73:0/2918497606 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000f450 con 0x7f6b381082a0 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.022+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b381a72a0 con 0x7f6b381082a0 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.023+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b38103110 con 0x7f6b381082a0 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.024+0000 7f6b34ff9640 1 -- 172.21.15.73:0/2918497606 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6b30004f60 con 0x7f6b381082a0 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.025+0000 7f6b34ff9640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6b200a2c10 0x7f6b200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.025+0000 7f6b377fe640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6b200a2c10 0x7f6b200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:34.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.025+0000 7f6b34ff9640 1 -- 172.21.15.73:0/2918497606 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f6b300ceea0 con 0x7f6b381082a0 2024-09-10T07:48:34.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.025+0000 7f6b377fe640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6b200a2c10 0x7f6b200a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005fd0 tx=0x7f6b28009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:34.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.029+0000 7f6b34ff9640 1 -- 172.21.15.73:0/2918497606 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b30014030 con 0x7f6b381082a0 2024-09-10T07:48:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:33 smithi102 ceph-mon[35514]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:48:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:33 smithi102 ceph-mon[35514]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:34.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:34.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:34.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:48:34.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:48:34.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:33 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:33 smithi159 ceph-mon[35522]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:48:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:33 smithi159 ceph-mon[35522]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:48:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:48:34.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:33 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' 2024-09-10T07:48:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.196+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b38062630 con 0x7f6b200a2c10 2024-09-10T07:48:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.202+0000 7f6b34ff9640 1 -- 172.21.15.73:0/2918497606 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258642 (secure 0 0 0) 0x7f6b38062630 con 0x7f6b200a2c10 2024-09-10T07:48:34.201 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-10T07:48:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6b200a2c10 msgr2=0x7f6b200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6b200a2c10 0x7f6b200a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005fd0 tx=0x7f6b28009870 comp rx=0 tx=0).stop 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381082a0 msgr2=0x7f6b38101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381082a0 0x7f6b38101410 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c970 tx=0x7f6b3000ce30 comp rx=0 tx=0).stop 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 shutdown_connections 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6b200a2c10 0x7f6b200a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b381082a0 0x7f6b38101410 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b381036e0 0x7f6b38100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 --2- 172.21.15.73:0/2918497606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b38102d30 0x7f6b38100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 >> 172.21.15.73:0/2918497606 conn(0x7f6b380fc7d0 msgr2=0x7f6b38105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 shutdown_connections 2024-09-10T07:48:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:34.205+0000 7f6b3deae640 1 -- 172.21.15.73:0/2918497606 wait complete. 2024-09-10T07:48:34.875 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-10T07:48:32.673939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":244,"num_read_kb":235,"num_write":266,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353600,"kb_used_data":12648,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588224,"statfs":{"total":1151940427776,"available":1151578341376,"internally_reserved":0,"allocated":12951552,"data_stored":7262409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002978"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174321+0000","last_change":"2024-09-10T07:47:31.876663+0000","last_active":"2024-09-10T07:47:46.174321+0000","last_peered":"2024-09-10T07:47:46.174321+0000","last_clean":"2024-09-10T07:47:46.174321+0000","last_became_active":"2024-09-10T07:47:31.876368+0000","last_became_peered":"2024-09-10T07:47:31.876368+0000","last_unstale":"2024-09-10T07:47:46.174321+0000","last_undegraded":"2024-09-10T07:47:46.174321+0000","last_fullsized":"2024-09-10T07:47:46.174321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:30.203753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176341+0000","last_change":"2024-09-10T07:47:31.867862+0000","last_active":"2024-09-10T07:47:46.176341+0000","last_peered":"2024-09-10T07:47:46.176341+0000","last_clean":"2024-09-10T07:47:46.176341+0000","last_became_active":"2024-09-10T07:47:31.867553+0000","last_became_peered":"2024-09-10T07:47:31.867553+0000","last_unstale":"2024-09-10T07:47:46.176341+0000","last_undegraded":"2024-09-10T07:47:46.176341+0000","last_fullsized":"2024-09-10T07:47:46.176341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:02.809443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176241+0000","last_change":"2024-09-10T07:47:31.873697+0000","last_active":"2024-09-10T07:47:46.176241+0000","last_peered":"2024-09-10T07:47:46.176241+0000","last_clean":"2024-09-10T07:47:46.176241+0000","last_became_active":"2024-09-10T07:47:31.873156+0000","last_became_peered":"2024-09-10T07:47:31.873156+0000","last_unstale":"2024-09-10T07:47:46.176241+0000","last_undegraded":"2024-09-10T07:47:46.176241+0000","last_fullsized":"2024-09-10T07:47:46.176241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:16.365317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192901+0000","last_change":"2024-09-10T07:47:31.869749+0000","last_active":"2024-09-10T07:47:46.192901+0000","last_peered":"2024-09-10T07:47:46.192901+0000","last_clean":"2024-09-10T07:47:46.192901+0000","last_became_active":"2024-09-10T07:47:31.868474+0000","last_became_peered":"2024-09-10T07:47:31.868474+0000","last_unstale":"2024-09-10T07:47:46.192901+0000","last_undegraded":"2024-09-10T07:47:46.192901+0000","last_fullsized":"2024-09-10T07:47:46.192901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:49.809017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177905+0000","last_change":"2024-09-10T07:47:31.864160+0000","last_active":"2024-09-10T07:47:46.177905+0000","last_peered":"2024-09-10T07:47:46.177905+0000","last_clean":"2024-09-10T07:47:46.177905+0000","last_became_active":"2024-09-10T07:47:31.862214+0000","last_became_peered":"2024-09-10T07:47:31.862214+0000","last_unstale":"2024-09-10T07:47:46.177905+0000","last_undegraded":"2024-09-10T07:47:46.177905+0000","last_fullsized":"2024-09-10T07:47:46.177905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:50.422218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.194241+0000","last_change":"2024-09-10T07:47:46.194241+0000","last_active":"2024-09-10T07:47:46.194241+0000","last_peered":"2024-09-10T07:47:46.194241+0000","last_clean":"2024-09-10T07:47:46.194241+0000","last_became_active":"2024-09-10T07:47:46.193667+0000","last_became_peered":"2024-09-10T07:47:46.193667+0000","last_unstale":"2024-09-10T07:47:46.194241+0000","last_undegraded":"2024-09-10T07:47:46.194241+0000","last_fullsized":"2024-09-10T07:47:46.194241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:05.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.193934+0000","last_change":"2024-09-10T07:47:46.193934+0000","last_active":"2024-09-10T07:47:46.193934+0000","last_peered":"2024-09-10T07:47:46.193934+0000","last_clean":"2024-09-10T07:47:46.193934+0000","last_became_active":"2024-09-10T07:47:46.193474+0000","last_became_peered":"2024-09-10T07:47:46.193474+0000","last_unstale":"2024-09-10T07:47:46.193934+0000","last_undegraded":"2024-09-10T07:47:46.193934+0000","last_fullsized":"2024-09-10T07:47:46.193934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:00.465345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171799+0000","last_change":"2024-09-10T07:47:31.871924+0000","last_active":"2024-09-10T07:47:46.171799+0000","last_peered":"2024-09-10T07:47:46.171799+0000","last_clean":"2024-09-10T07:47:46.171799+0000","last_became_active":"2024-09-10T07:47:31.871639+0000","last_became_peered":"2024-09-10T07:47:31.871639+0000","last_unstale":"2024-09-10T07:47:46.171799+0000","last_undegraded":"2024-09-10T07:47:46.171799+0000","last_fullsized":"2024-09-10T07:47:46.171799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:48.248506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173438+0000","last_change":"2024-09-10T07:47:31.876528+0000","last_active":"2024-09-10T07:47:46.173438+0000","last_peered":"2024-09-10T07:47:46.173438+0000","last_clean":"2024-09-10T07:47:46.173438+0000","last_became_active":"2024-09-10T07:47:31.876022+0000","last_became_peered":"2024-09-10T07:47:31.876022+0000","last_unstale":"2024-09-10T07:47:46.173438+0000","last_undegraded":"2024-09-10T07:47:46.173438+0000","last_fullsized":"2024-09-10T07:47:46.173438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:07.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177291+0000","last_change":"2024-09-10T07:47:31.864740+0000","last_active":"2024-09-10T07:47:46.177291+0000","last_peered":"2024-09-10T07:47:46.177291+0000","last_clean":"2024-09-10T07:47:46.177291+0000","last_became_active":"2024-09-10T07:47:31.864138+0000","last_became_peered":"2024-09-10T07:47:31.864138+0000","last_unstale":"2024-09-10T07:47:46.177291+0000","last_undegraded":"2024-09-10T07:47:46.177291+0000","last_fullsized":"2024-09-10T07:47:46.177291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:27.248169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174342+0000","last_change":"2024-09-10T07:47:31.875751+0000","last_active":"2024-09-10T07:47:46.174342+0000","last_peered":"2024-09-10T07:47:46.174342+0000","last_clean":"2024-09-10T07:47:46.174342+0000","last_became_active":"2024-09-10T07:47:31.875399+0000","last_became_peered":"2024-09-10T07:47:31.875399+0000","last_unstale":"2024-09-10T07:47:46.174342+0000","last_undegraded":"2024-09-10T07:47:46.174342+0000","last_fullsized":"2024-09-10T07:47:46.174342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:19.439947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192991+0000","last_change":"2024-09-10T07:47:31.870220+0000","last_active":"2024-09-10T07:47:46.192991+0000","last_peered":"2024-09-10T07:47:46.192991+0000","last_clean":"2024-09-10T07:47:46.192991+0000","last_became_active":"2024-09-10T07:47:31.869018+0000","last_became_peered":"2024-09-10T07:47:31.869018+0000","last_unstale":"2024-09-10T07:47:46.192991+0000","last_undegraded":"2024-09-10T07:47:46.192991+0000","last_fullsized":"2024-09-10T07:47:46.192991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:52.108972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192766+0000","last_change":"2024-09-10T07:47:31.868419+0000","last_active":"2024-09-10T07:47:46.192766+0000","last_peered":"2024-09-10T07:47:46.192766+0000","last_clean":"2024-09-10T07:47:46.192766+0000","last_became_active":"2024-09-10T07:47:31.868093+0000","last_became_peered":"2024-09-10T07:47:31.868093+0000","last_unstale":"2024-09-10T07:47:46.192766+0000","last_undegraded":"2024-09-10T07:47:46.192766+0000","last_fullsized":"2024-09-10T07:47:46.192766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:24.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176134+0000","last_change":"2024-09-10T07:47:31.866974+0000","last_active":"2024-09-10T07:47:46.176134+0000","last_peered":"2024-09-10T07:47:46.176134+0000","last_clean":"2024-09-10T07:47:46.176134+0000","last_became_active":"2024-09-10T07:47:31.866579+0000","last_became_peered":"2024-09-10T07:47:31.866579+0000","last_unstale":"2024-09-10T07:47:46.176134+0000","last_undegraded":"2024-09-10T07:47:46.176134+0000","last_fullsized":"2024-09-10T07:47:46.176134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:47.140259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.180225+0000","last_change":"2024-09-10T07:47:46.180225+0000","last_active":"2024-09-10T07:47:46.180225+0000","last_peered":"2024-09-10T07:47:46.180225+0000","last_clean":"2024-09-10T07:47:46.180225+0000","last_became_active":"2024-09-10T07:47:46.179885+0000","last_became_peered":"2024-09-10T07:47:46.179885+0000","last_unstale":"2024-09-10T07:47:46.180225+0000","last_undegraded":"2024-09-10T07:47:46.180225+0000","last_fullsized":"2024-09-10T07:47:46.180225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:00.796740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172587+0000","last_change":"2024-09-10T07:47:31.876926+0000","last_active":"2024-09-10T07:47:46.172587+0000","last_peered":"2024-09-10T07:47:46.172587+0000","last_clean":"2024-09-10T07:47:46.172587+0000","last_became_active":"2024-09-10T07:47:31.876620+0000","last_became_peered":"2024-09-10T07:47:31.876620+0000","last_unstale":"2024-09-10T07:47:46.172587+0000","last_undegraded":"2024-09-10T07:47:46.172587+0000","last_fullsized":"2024-09-10T07:47:46.172587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:53.863927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174354+0000","last_change":"2024-09-10T07:47:31.871088+0000","last_active":"2024-09-10T07:47:46.174354+0000","last_peered":"2024-09-10T07:47:46.174354+0000","last_clean":"2024-09-10T07:47:46.174354+0000","last_became_active":"2024-09-10T07:47:31.870709+0000","last_became_peered":"2024-09-10T07:47:31.870709+0000","last_unstale":"2024-09-10T07:47:46.174354+0000","last_undegraded":"2024-09-10T07:47:46.174354+0000","last_fullsized":"2024-09-10T07:47:46.174354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:34.964229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174874+0000","last_change":"2024-09-10T07:47:31.869310+0000","last_active":"2024-09-10T07:47:46.174874+0000","last_peered":"2024-09-10T07:47:46.174874+0000","last_clean":"2024-09-10T07:47:46.174874+0000","last_became_active":"2024-09-10T07:47:31.868892+0000","last_became_peered":"2024-09-10T07:47:31.868892+0000","last_unstale":"2024-09-10T07:47:46.174874+0000","last_undegraded":"2024-09-10T07:47:46.174874+0000","last_fullsized":"2024-09-10T07:47:46.174874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:15.338010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177118+0000","last_change":"2024-09-10T07:47:31.867938+0000","last_active":"2024-09-10T07:47:46.177118+0000","last_peered":"2024-09-10T07:47:46.177118+0000","last_clean":"2024-09-10T07:47:46.177118+0000","last_became_active":"2024-09-10T07:47:31.867556+0000","last_became_peered":"2024-09-10T07:47:31.867556+0000","last_unstale":"2024-09-10T07:47:46.177118+0000","last_undegraded":"2024-09-10T07:47:46.177118+0000","last_fullsized":"2024-09-10T07:47:46.177118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:43.198241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173966+0000","last_change":"2024-09-10T07:47:31.864157+0000","last_active":"2024-09-10T07:47:46.173966+0000","last_peered":"2024-09-10T07:47:46.173966+0000","last_clean":"2024-09-10T07:47:46.173966+0000","last_became_active":"2024-09-10T07:47:31.863802+0000","last_became_peered":"2024-09-10T07:47:31.863802+0000","last_unstale":"2024-09-10T07:47:46.173966+0000","last_undegraded":"2024-09-10T07:47:46.173966+0000","last_fullsized":"2024-09-10T07:47:46.173966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:03.492869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192857+0000","last_change":"2024-09-10T07:47:31.865404+0000","last_active":"2024-09-10T07:47:46.192857+0000","last_peered":"2024-09-10T07:47:46.192857+0000","last_clean":"2024-09-10T07:47:46.192857+0000","last_became_active":"2024-09-10T07:47:31.865098+0000","last_became_peered":"2024-09-10T07:47:31.865098+0000","last_unstale":"2024-09-10T07:47:46.192857+0000","last_undegraded":"2024-09-10T07:47:46.192857+0000","last_fullsized":"2024-09-10T07:47:46.192857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:56.111270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172776+0000","last_change":"2024-09-10T07:47:31.869880+0000","last_active":"2024-09-10T07:47:46.172776+0000","last_peered":"2024-09-10T07:47:46.172776+0000","last_clean":"2024-09-10T07:47:46.172776+0000","last_became_active":"2024-09-10T07:47:31.869535+0000","last_became_peered":"2024-09-10T07:47:31.869535+0000","last_unstale":"2024-09-10T07:47:46.172776+0000","last_undegraded":"2024-09-10T07:47:46.172776+0000","last_fullsized":"2024-09-10T07:47:46.172776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:53.157821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171861+0000","last_change":"2024-09-10T07:47:31.867799+0000","last_active":"2024-09-10T07:47:46.171861+0000","last_peered":"2024-09-10T07:47:46.171861+0000","last_clean":"2024-09-10T07:47:46.171861+0000","last_became_active":"2024-09-10T07:47:31.867499+0000","last_became_peered":"2024-09-10T07:47:31.867499+0000","last_unstale":"2024-09-10T07:47:46.171861+0000","last_undegraded":"2024-09-10T07:47:46.171861+0000","last_fullsized":"2024-09-10T07:47:46.171861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:47.340340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177625+0000","last_change":"2024-09-10T07:47:46.176635+0000","last_active":"2024-09-10T07:47:46.177625+0000","last_peered":"2024-09-10T07:47:46.177625+0000","last_clean":"2024-09-10T07:47:46.177625+0000","last_became_active":"2024-09-10T07:47:46.176225+0000","last_became_peered":"2024-09-10T07:47:46.176225+0000","last_unstale":"2024-09-10T07:47:46.177625+0000","last_undegraded":"2024-09-10T07:47:46.177625+0000","last_fullsized":"2024-09-10T07:47:46.177625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:33.258318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172991+0000","last_change":"2024-09-10T07:47:31.864776+0000","last_active":"2024-09-10T07:47:46.172991+0000","last_peered":"2024-09-10T07:47:46.172991+0000","last_clean":"2024-09-10T07:47:46.172991+0000","last_became_active":"2024-09-10T07:47:31.864446+0000","last_became_peered":"2024-09-10T07:47:31.864446+0000","last_unstale":"2024-09-10T07:47:46.172991+0000","last_undegraded":"2024-09-10T07:47:46.172991+0000","last_fullsized":"2024-09-10T07:47:46.172991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:38.976206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177130+0000","last_change":"2024-09-10T07:47:31.871688+0000","last_active":"2024-09-10T07:47:46.177130+0000","last_peered":"2024-09-10T07:47:46.177130+0000","last_clean":"2024-09-10T07:47:46.177130+0000","last_became_active":"2024-09-10T07:47:31.871484+0000","last_became_peered":"2024-09-10T07:47:31.871484+0000","last_unstale":"2024-09-10T07:47:46.177130+0000","last_undegraded":"2024-09-10T07:47:46.177130+0000","last_fullsized":"2024-09-10T07:47:46.177130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:53.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174171+0000","last_change":"2024-09-10T07:47:31.868919+0000","last_active":"2024-09-10T07:47:46.174171+0000","last_peered":"2024-09-10T07:47:46.174171+0000","last_clean":"2024-09-10T07:47:46.174171+0000","last_became_active":"2024-09-10T07:47:31.868593+0000","last_became_peered":"2024-09-10T07:47:31.868593+0000","last_unstale":"2024-09-10T07:47:46.174171+0000","last_undegraded":"2024-09-10T07:47:46.174171+0000","last_fullsized":"2024-09-10T07:47:46.174171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:02.814977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192808+0000","last_change":"2024-09-10T07:47:31.863674+0000","last_active":"2024-09-10T07:47:46.192808+0000","last_peered":"2024-09-10T07:47:46.192808+0000","last_clean":"2024-09-10T07:47:46.192808+0000","last_became_active":"2024-09-10T07:47:31.863347+0000","last_became_peered":"2024-09-10T07:47:31.863347+0000","last_unstale":"2024-09-10T07:47:46.192808+0000","last_undegraded":"2024-09-10T07:47:46.192808+0000","last_fullsized":"2024-09-10T07:47:46.192808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:55.819510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176196+0000","last_change":"2024-09-10T07:47:31.869710+0000","last_active":"2024-09-10T07:47:46.176196+0000","last_peered":"2024-09-10T07:47:46.176196+0000","last_clean":"2024-09-10T07:47:46.176196+0000","last_became_active":"2024-09-10T07:47:31.869284+0000","last_became_peered":"2024-09-10T07:47:31.869284+0000","last_unstale":"2024-09-10T07:47:46.176196+0000","last_undegraded":"2024-09-10T07:47:46.176196+0000","last_fullsized":"2024-09-10T07:47:46.176196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:49.128941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176605+0000","last_change":"2024-09-10T07:47:31.865576+0000","last_active":"2024-09-10T07:47:46.176605+0000","last_peered":"2024-09-10T07:47:46.176605+0000","last_clean":"2024-09-10T07:47:46.176605+0000","last_became_active":"2024-09-10T07:47:31.865225+0000","last_became_peered":"2024-09-10T07:47:31.865225+0000","last_unstale":"2024-09-10T07:47:46.176605+0000","last_undegraded":"2024-09-10T07:47:46.176605+0000","last_fullsized":"2024-09-10T07:47:46.176605+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:10.390091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176806+0000","last_change":"2024-09-10T07:47:31.869155+0000","last_active":"2024-09-10T07:47:46.176806+0000","last_peered":"2024-09-10T07:47:46.176806+0000","last_clean":"2024-09-10T07:47:46.176806+0000","last_became_active":"2024-09-10T07:47:31.868737+0000","last_became_peered":"2024-09-10T07:47:31.868737+0000","last_unstale":"2024-09-10T07:47:46.176806+0000","last_undegraded":"2024-09-10T07:47:46.176806+0000","last_fullsized":"2024-09-10T07:47:46.176806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:16.123687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173764+0000","last_change":"2024-09-10T07:47:31.870079+0000","last_active":"2024-09-10T07:47:46.173764+0000","last_peered":"2024-09-10T07:47:46.173764+0000","last_clean":"2024-09-10T07:47:46.173764+0000","last_became_active":"2024-09-10T07:47:31.869554+0000","last_became_peered":"2024-09-10T07:47:31.869554+0000","last_unstale":"2024-09-10T07:47:46.173764+0000","last_undegraded":"2024-09-10T07:47:46.173764+0000","last_fullsized":"2024-09-10T07:47:46.173764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:54.685962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177344+0000","last_change":"2024-09-10T07:47:31.867605+0000","last_active":"2024-09-10T07:47:46.177344+0000","last_peered":"2024-09-10T07:47:46.177344+0000","last_clean":"2024-09-10T07:47:46.177344+0000","last_became_active":"2024-09-10T07:47:31.867296+0000","last_became_peered":"2024-09-10T07:47:31.867296+0000","last_unstale":"2024-09-10T07:47:46.177344+0000","last_undegraded":"2024-09-10T07:47:46.177344+0000","last_fullsized":"2024-09-10T07:47:46.177344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:59.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172952+0000","last_change":"2024-09-10T07:47:29.862795+0000","last_active":"2024-09-10T07:47:46.172952+0000","last_peered":"2024-09-10T07:47:46.172952+0000","last_clean":"2024-09-10T07:47:46.172952+0000","last_became_active":"2024-09-10T07:47:29.862437+0000","last_became_peered":"2024-09-10T07:47:29.862437+0000","last_unstale":"2024-09-10T07:47:46.172952+0000","last_undegraded":"2024-09-10T07:47:46.172952+0000","last_fullsized":"2024-09-10T07:47:46.172952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:34.233270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172849+0000","last_change":"2024-09-10T07:47:31.868932+0000","last_active":"2024-09-10T07:47:46.172849+0000","last_peered":"2024-09-10T07:47:46.172849+0000","last_clean":"2024-09-10T07:47:46.172849+0000","last_became_active":"2024-09-10T07:47:31.868534+0000","last_became_peered":"2024-09-10T07:47:31.868534+0000","last_unstale":"2024-09-10T07:47:46.172849+0000","last_undegraded":"2024-09-10T07:47:46.172849+0000","last_fullsized":"2024-09-10T07:47:46.172849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:12.164453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177434+0000","last_change":"2024-09-10T07:47:29.858029+0000","last_active":"2024-09-10T07:47:46.177434+0000","last_peered":"2024-09-10T07:47:46.177434+0000","last_clean":"2024-09-10T07:47:46.177434+0000","last_became_active":"2024-09-10T07:47:29.857556+0000","last_became_peered":"2024-09-10T07:47:29.857556+0000","last_unstale":"2024-09-10T07:47:46.177434+0000","last_undegraded":"2024-09-10T07:47:46.177434+0000","last_fullsized":"2024-09-10T07:47:46.177434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:37.831252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192589+0000","last_change":"2024-09-10T07:47:29.856390+0000","last_active":"2024-09-10T07:47:46.192589+0000","last_peered":"2024-09-10T07:47:46.192589+0000","last_clean":"2024-09-10T07:47:46.192589+0000","last_became_active":"2024-09-10T07:47:29.856042+0000","last_became_peered":"2024-09-10T07:47:29.856042+0000","last_unstale":"2024-09-10T07:47:46.192589+0000","last_undegraded":"2024-09-10T07:47:46.192589+0000","last_fullsized":"2024-09-10T07:47:46.192589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:57.934410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171927+0000","last_change":"2024-09-10T07:47:31.863414+0000","last_active":"2024-09-10T07:47:46.171927+0000","last_peered":"2024-09-10T07:47:46.171927+0000","last_clean":"2024-09-10T07:47:46.171927+0000","last_became_active":"2024-09-10T07:47:31.863116+0000","last_became_peered":"2024-09-10T07:47:31.863116+0000","last_unstale":"2024-09-10T07:47:46.171927+0000","last_undegraded":"2024-09-10T07:47:46.171927+0000","last_fullsized":"2024-09-10T07:47:46.171927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:02.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172688+0000","last_change":"2024-09-10T07:47:29.860106+0000","last_active":"2024-09-10T07:47:46.172688+0000","last_peered":"2024-09-10T07:47:46.172688+0000","last_clean":"2024-09-10T07:47:46.172688+0000","last_became_active":"2024-09-10T07:47:29.859700+0000","last_became_peered":"2024-09-10T07:47:29.859700+0000","last_unstale":"2024-09-10T07:47:46.172688+0000","last_undegraded":"2024-09-10T07:47:46.172688+0000","last_fullsized":"2024-09-10T07:47:46.172688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:07.832889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174363+0000","last_change":"2024-09-10T07:47:31.866263+0000","last_active":"2024-09-10T07:47:46.174363+0000","last_peered":"2024-09-10T07:47:46.174363+0000","last_clean":"2024-09-10T07:47:46.174363+0000","last_became_active":"2024-09-10T07:47:31.865911+0000","last_became_peered":"2024-09-10T07:47:31.865911+0000","last_unstale":"2024-09-10T07:47:46.174363+0000","last_undegraded":"2024-09-10T07:47:46.174363+0000","last_fullsized":"2024-09-10T07:47:46.174363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:53.644360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177424+0000","last_change":"2024-09-10T07:47:29.861490+0000","last_active":"2024-09-10T07:47:46.177424+0000","last_peered":"2024-09-10T07:47:46.177424+0000","last_clean":"2024-09-10T07:47:46.177424+0000","last_became_active":"2024-09-10T07:47:29.861042+0000","last_became_peered":"2024-09-10T07:47:29.861042+0000","last_unstale":"2024-09-10T07:47:46.177424+0000","last_undegraded":"2024-09-10T07:47:46.177424+0000","last_fullsized":"2024-09-10T07:47:46.177424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:12.626954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173037+0000","last_change":"2024-09-10T07:47:31.871792+0000","last_active":"2024-09-10T07:47:46.173037+0000","last_peered":"2024-09-10T07:47:46.173037+0000","last_clean":"2024-09-10T07:47:46.173037+0000","last_became_active":"2024-09-10T07:47:31.870859+0000","last_became_peered":"2024-09-10T07:47:31.870859+0000","last_unstale":"2024-09-10T07:47:46.173037+0000","last_undegraded":"2024-09-10T07:47:46.173037+0000","last_fullsized":"2024-09-10T07:47:46.173037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:08.479377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174617+0000","last_change":"2024-09-10T07:47:29.862475+0000","last_active":"2024-09-10T07:47:46.174617+0000","last_peered":"2024-09-10T07:47:46.174617+0000","last_clean":"2024-09-10T07:47:46.174617+0000","last_became_active":"2024-09-10T07:47:29.862094+0000","last_became_peered":"2024-09-10T07:47:29.862094+0000","last_unstale":"2024-09-10T07:47:46.174617+0000","last_undegraded":"2024-09-10T07:47:46.174617+0000","last_fullsized":"2024-09-10T07:47:46.174617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:25.933844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176742+0000","last_change":"2024-09-10T07:47:31.868963+0000","last_active":"2024-09-10T07:47:46.176742+0000","last_peered":"2024-09-10T07:47:46.176742+0000","last_clean":"2024-09-10T07:47:46.176742+0000","last_became_active":"2024-09-10T07:47:31.868650+0000","last_became_peered":"2024-09-10T07:47:31.868650+0000","last_unstale":"2024-09-10T07:47:46.176742+0000","last_undegraded":"2024-09-10T07:47:46.176742+0000","last_fullsized":"2024-09-10T07:47:46.176742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:39.613235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172874+0000","last_change":"2024-09-10T07:47:29.861572+0000","last_active":"2024-09-10T07:47:46.172874+0000","last_peered":"2024-09-10T07:47:46.172874+0000","last_clean":"2024-09-10T07:47:46.172874+0000","last_became_active":"2024-09-10T07:47:29.860710+0000","last_became_peered":"2024-09-10T07:47:29.860710+0000","last_unstale":"2024-09-10T07:47:46.172874+0000","last_undegraded":"2024-09-10T07:47:46.172874+0000","last_fullsized":"2024-09-10T07:47:46.172874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:28.535090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173093+0000","last_change":"2024-09-10T07:47:31.869976+0000","last_active":"2024-09-10T07:47:46.173093+0000","last_peered":"2024-09-10T07:47:46.173093+0000","last_clean":"2024-09-10T07:47:46.173093+0000","last_became_active":"2024-09-10T07:47:31.868678+0000","last_became_peered":"2024-09-10T07:47:31.868678+0000","last_unstale":"2024-09-10T07:47:46.173093+0000","last_undegraded":"2024-09-10T07:47:46.173093+0000","last_fullsized":"2024-09-10T07:47:46.173093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:38.362180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'27","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:48:27.176714+0000","last_change":"2024-09-10T07:47:29.863534+0000","last_active":"2024-09-10T07:48:27.176714+0000","last_peered":"2024-09-10T07:48:27.176714+0000","last_clean":"2024-09-10T07:48:27.176714+0000","last_became_active":"2024-09-10T07:47:29.863136+0000","last_became_peered":"2024-09-10T07:47:29.863136+0000","last_unstale":"2024-09-10T07:48:27.176714+0000","last_undegraded":"2024-09-10T07:48:27.176714+0000","last_fullsized":"2024-09-10T07:48:27.176714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:21.261019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":105,"num_read_kb":113,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178297+0000","last_change":"2024-09-10T07:47:31.866435+0000","last_active":"2024-09-10T07:47:46.178297+0000","last_peered":"2024-09-10T07:47:46.178297+0000","last_clean":"2024-09-10T07:47:46.178297+0000","last_became_active":"2024-09-10T07:47:31.866099+0000","last_became_peered":"2024-09-10T07:47:31.866099+0000","last_unstale":"2024-09-10T07:47:46.178297+0000","last_undegraded":"2024-09-10T07:47:46.178297+0000","last_fullsized":"2024-09-10T07:47:46.178297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177210+0000","last_change":"2024-09-10T07:47:29.862633+0000","last_active":"2024-09-10T07:47:46.177210+0000","last_peered":"2024-09-10T07:47:46.177210+0000","last_clean":"2024-09-10T07:47:46.177210+0000","last_became_active":"2024-09-10T07:47:29.862214+0000","last_became_peered":"2024-09-10T07:47:29.862214+0000","last_unstale":"2024-09-10T07:47:46.177210+0000","last_undegraded":"2024-09-10T07:47:46.177210+0000","last_fullsized":"2024-09-10T07:47:46.177210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:34.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192682+0000","last_change":"2024-09-10T07:47:31.863361+0000","last_active":"2024-09-10T07:47:46.192682+0000","last_peered":"2024-09-10T07:47:46.192682+0000","last_clean":"2024-09-10T07:47:46.192682+0000","last_became_active":"2024-09-10T07:47:31.863048+0000","last_became_peered":"2024-09-10T07:47:31.863048+0000","last_unstale":"2024-09-10T07:47:46.192682+0000","last_undegraded":"2024-09-10T07:47:46.192682+0000","last_fullsized":"2024-09-10T07:47:46.192682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:54.770006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173311+0000","last_change":"2024-09-10T07:47:29.858767+0000","last_active":"2024-09-10T07:47:46.173311+0000","last_peered":"2024-09-10T07:47:46.173311+0000","last_clean":"2024-09-10T07:47:46.173311+0000","last_became_active":"2024-09-10T07:47:29.858419+0000","last_became_peered":"2024-09-10T07:47:29.858419+0000","last_unstale":"2024-09-10T07:47:46.173311+0000","last_undegraded":"2024-09-10T07:47:46.173311+0000","last_fullsized":"2024-09-10T07:47:46.173311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:03.642873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174068+0000","last_change":"2024-09-10T07:47:31.870593+0000","last_active":"2024-09-10T07:47:46.174068+0000","last_peered":"2024-09-10T07:47:46.174068+0000","last_clean":"2024-09-10T07:47:46.174068+0000","last_became_active":"2024-09-10T07:47:31.870285+0000","last_became_peered":"2024-09-10T07:47:31.870285+0000","last_unstale":"2024-09-10T07:47:46.174068+0000","last_undegraded":"2024-09-10T07:47:46.174068+0000","last_fullsized":"2024-09-10T07:47:46.174068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:49.370065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192726+0000","last_change":"2024-09-10T07:47:29.856937+0000","last_active":"2024-09-10T07:47:46.192726+0000","last_peered":"2024-09-10T07:47:46.192726+0000","last_clean":"2024-09-10T07:47:46.192726+0000","last_became_active":"2024-09-10T07:47:29.856559+0000","last_became_peered":"2024-09-10T07:47:29.856559+0000","last_unstale":"2024-09-10T07:47:46.192726+0000","last_undegraded":"2024-09-10T07:47:46.192726+0000","last_fullsized":"2024-09-10T07:47:46.192726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:01.135693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174684+0000","last_change":"2024-09-10T07:47:31.871743+0000","last_active":"2024-09-10T07:47:46.174684+0000","last_peered":"2024-09-10T07:47:46.174684+0000","last_clean":"2024-09-10T07:47:46.174684+0000","last_became_active":"2024-09-10T07:47:31.871395+0000","last_became_peered":"2024-09-10T07:47:31.871395+0000","last_unstale":"2024-09-10T07:47:46.174684+0000","last_undegraded":"2024-09-10T07:47:46.174684+0000","last_fullsized":"2024-09-10T07:47:46.174684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:18.450216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176747+0000","last_change":"2024-09-10T07:47:29.863405+0000","last_active":"2024-09-10T07:47:46.176747+0000","last_peered":"2024-09-10T07:47:46.176747+0000","last_clean":"2024-09-10T07:47:46.176747+0000","last_became_active":"2024-09-10T07:47:29.862832+0000","last_became_peered":"2024-09-10T07:47:29.862832+0000","last_unstale":"2024-09-10T07:47:46.176747+0000","last_undegraded":"2024-09-10T07:47:46.176747+0000","last_fullsized":"2024-09-10T07:47:46.176747+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:10.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173136+0000","last_change":"2024-09-10T07:47:31.872412+0000","last_active":"2024-09-10T07:47:46.173136+0000","last_peered":"2024-09-10T07:47:46.173136+0000","last_clean":"2024-09-10T07:47:46.173136+0000","last_became_active":"2024-09-10T07:47:31.871380+0000","last_became_peered":"2024-09-10T07:47:31.871380+0000","last_unstale":"2024-09-10T07:47:46.173136+0000","last_undegraded":"2024-09-10T07:47:46.173136+0000","last_fullsized":"2024-09-10T07:47:46.173136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:09.730443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178875+0000","last_change":"2024-09-10T07:47:29.861556+0000","last_active":"2024-09-10T07:47:46.178875+0000","last_peered":"2024-09-10T07:47:46.178875+0000","last_clean":"2024-09-10T07:47:46.178875+0000","last_became_active":"2024-09-10T07:47:29.861053+0000","last_became_peered":"2024-09-10T07:47:29.861053+0000","last_unstale":"2024-09-10T07:47:46.178875+0000","last_undegraded":"2024-09-10T07:47:46.178875+0000","last_fullsized":"2024-09-10T07:47:46.178875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:21.969667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174106+0000","last_change":"2024-09-10T07:47:31.868023+0000","last_active":"2024-09-10T07:47:46.174106+0000","last_peered":"2024-09-10T07:47:46.174106+0000","last_clean":"2024-09-10T07:47:46.174106+0000","last_became_active":"2024-09-10T07:47:31.867722+0000","last_became_peered":"2024-09-10T07:47:31.867722+0000","last_unstale":"2024-09-10T07:47:46.174106+0000","last_undegraded":"2024-09-10T07:47:46.174106+0000","last_fullsized":"2024-09-10T07:47:46.174106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:01.399800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192980+0000","last_change":"2024-09-10T07:47:29.862054+0000","last_active":"2024-09-10T07:47:46.192980+0000","last_peered":"2024-09-10T07:47:46.192980+0000","last_clean":"2024-09-10T07:47:46.192980+0000","last_became_active":"2024-09-10T07:47:29.861731+0000","last_became_peered":"2024-09-10T07:47:29.861731+0000","last_unstale":"2024-09-10T07:47:46.192980+0000","last_undegraded":"2024-09-10T07:47:46.192980+0000","last_fullsized":"2024-09-10T07:47:46.192980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:45.043458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174768+0000","last_change":"2024-09-10T07:47:31.871372+0000","last_active":"2024-09-10T07:47:46.174768+0000","last_peered":"2024-09-10T07:47:46.174768+0000","last_clean":"2024-09-10T07:47:46.174768+0000","last_became_active":"2024-09-10T07:47:31.871048+0000","last_became_peered":"2024-09-10T07:47:31.871048+0000","last_unstale":"2024-09-10T07:47:46.174768+0000","last_undegraded":"2024-09-10T07:47:46.174768+0000","last_fullsized":"2024-09-10T07:47:46.174768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:58.934809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172999+0000","last_change":"2024-09-10T07:47:29.861974+0000","last_active":"2024-09-10T07:47:46.172999+0000","last_peered":"2024-09-10T07:47:46.172999+0000","last_clean":"2024-09-10T07:47:46.172999+0000","last_became_active":"2024-09-10T07:47:29.861240+0000","last_became_peered":"2024-09-10T07:47:29.861240+0000","last_unstale":"2024-09-10T07:47:46.172999+0000","last_undegraded":"2024-09-10T07:47:46.172999+0000","last_fullsized":"2024-09-10T07:47:46.172999+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:05.235927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174244+0000","last_change":"2024-09-10T07:47:31.871807+0000","last_active":"2024-09-10T07:47:46.174244+0000","last_peered":"2024-09-10T07:47:46.174244+0000","last_clean":"2024-09-10T07:47:46.174244+0000","last_became_active":"2024-09-10T07:47:31.871489+0000","last_became_peered":"2024-09-10T07:47:31.871489+0000","last_unstale":"2024-09-10T07:47:46.174244+0000","last_undegraded":"2024-09-10T07:47:46.174244+0000","last_fullsized":"2024-09-10T07:47:46.174244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:00.754188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176930+0000","last_change":"2024-09-10T07:47:30.089332+0000","last_active":"2024-09-10T07:47:46.176930+0000","last_peered":"2024-09-10T07:47:46.176930+0000","last_clean":"2024-09-10T07:47:46.176930+0000","last_became_active":"2024-09-10T07:47:30.088879+0000","last_became_peered":"2024-09-10T07:47:30.088879+0000","last_unstale":"2024-09-10T07:47:46.176930+0000","last_undegraded":"2024-09-10T07:47:46.176930+0000","last_fullsized":"2024-09-10T07:47:46.176930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:40.875957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174405+0000","last_change":"2024-09-10T07:47:31.873732+0000","last_active":"2024-09-10T07:47:46.174405+0000","last_peered":"2024-09-10T07:47:46.174405+0000","last_clean":"2024-09-10T07:47:46.174405+0000","last_became_active":"2024-09-10T07:47:31.873291+0000","last_became_peered":"2024-09-10T07:47:31.873291+0000","last_unstale":"2024-09-10T07:47:46.174405+0000","last_undegraded":"2024-09-10T07:47:46.174405+0000","last_fullsized":"2024-09-10T07:47:46.174405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:02.095237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174815+0000","last_change":"2024-09-10T07:46:21.922704+0000","last_active":"2024-09-10T07:47:46.174815+0000","last_peered":"2024-09-10T07:47:46.174815+0000","last_clean":"2024-09-10T07:47:46.174815+0000","last_became_active":"2024-09-10T07:46:21.922144+0000","last_became_peered":"2024-09-10T07:46:21.922144+0000","last_unstale":"2024-09-10T07:47:46.174815+0000","last_undegraded":"2024-09-10T07:47:46.174815+0000","last_fullsized":"2024-09-10T07:47:46.174815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:42:58.927087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:42:58.927087+0000","last_clean_scrub_stamp":"2024-09-10T07:42:58.927087+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:11.355989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192853+0000","last_change":"2024-09-10T07:47:29.859739+0000","last_active":"2024-09-10T07:47:46.192853+0000","last_peered":"2024-09-10T07:47:46.192853+0000","last_clean":"2024-09-10T07:47:46.192853+0000","last_became_active":"2024-09-10T07:47:29.859223+0000","last_became_peered":"2024-09-10T07:47:29.859223+0000","last_unstale":"2024-09-10T07:47:46.192853+0000","last_undegraded":"2024-09-10T07:47:46.192853+0000","last_fullsized":"2024-09-10T07:47:46.192853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:48.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176834+0000","last_change":"2024-09-10T07:47:46.176368+0000","last_active":"2024-09-10T07:47:46.176834+0000","last_peered":"2024-09-10T07:47:46.176834+0000","last_clean":"2024-09-10T07:47:46.176834+0000","last_became_active":"2024-09-10T07:47:46.176008+0000","last_became_peered":"2024-09-10T07:47:46.176008+0000","last_unstale":"2024-09-10T07:47:46.176834+0000","last_undegraded":"2024-09-10T07:47:46.176834+0000","last_fullsized":"2024-09-10T07:47:46.176834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:45.707644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174793+0000","last_change":"2024-09-10T07:47:29.861314+0000","last_active":"2024-09-10T07:47:46.174793+0000","last_peered":"2024-09-10T07:47:46.174793+0000","last_clean":"2024-09-10T07:47:46.174793+0000","last_became_active":"2024-09-10T07:47:29.860946+0000","last_became_peered":"2024-09-10T07:47:29.860946+0000","last_unstale":"2024-09-10T07:47:46.174793+0000","last_undegraded":"2024-09-10T07:47:46.174793+0000","last_fullsized":"2024-09-10T07:47:46.174793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:38.530660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192570+0000","last_change":"2024-09-10T07:47:31.867374+0000","last_active":"2024-09-10T07:47:46.192570+0000","last_peered":"2024-09-10T07:47:46.192570+0000","last_clean":"2024-09-10T07:47:46.192570+0000","last_became_active":"2024-09-10T07:47:31.867065+0000","last_became_peered":"2024-09-10T07:47:31.867065+0000","last_unstale":"2024-09-10T07:47:46.192570+0000","last_undegraded":"2024-09-10T07:47:46.192570+0000","last_fullsized":"2024-09-10T07:47:46.192570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:07.688314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192682+0000","last_change":"2024-09-10T07:47:29.854853+0000","last_active":"2024-09-10T07:47:46.192682+0000","last_peered":"2024-09-10T07:47:46.192682+0000","last_clean":"2024-09-10T07:47:46.192682+0000","last_became_active":"2024-09-10T07:47:29.854553+0000","last_became_peered":"2024-09-10T07:47:29.854553+0000","last_unstale":"2024-09-10T07:47:46.192682+0000","last_undegraded":"2024-09-10T07:47:46.192682+0000","last_fullsized":"2024-09-10T07:47:46.192682+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:34.570076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172538+0000","last_change":"2024-09-10T07:47:31.868522+0000","last_active":"2024-09-10T07:47:46.172538+0000","last_peered":"2024-09-10T07:47:46.172538+0000","last_clean":"2024-09-10T07:47:46.172538+0000","last_became_active":"2024-09-10T07:47:31.868114+0000","last_became_peered":"2024-09-10T07:47:31.868114+0000","last_unstale":"2024-09-10T07:47:46.172538+0000","last_undegraded":"2024-09-10T07:47:46.172538+0000","last_fullsized":"2024-09-10T07:47:46.172538+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.442513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174097+0000","last_change":"2024-09-10T07:47:29.856185+0000","last_active":"2024-09-10T07:47:46.174097+0000","last_peered":"2024-09-10T07:47:46.174097+0000","last_clean":"2024-09-10T07:47:46.174097+0000","last_became_active":"2024-09-10T07:47:29.855809+0000","last_became_peered":"2024-09-10T07:47:29.855809+0000","last_unstale":"2024-09-10T07:47:46.174097+0000","last_undegraded":"2024-09-10T07:47:46.174097+0000","last_fullsized":"2024-09-10T07:47:46.174097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:55.325391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.177351+0000","last_change":"2024-09-10T07:47:31.862955+0000","last_active":"2024-09-10T07:47:46.177351+0000","last_peered":"2024-09-10T07:47:46.177351+0000","last_clean":"2024-09-10T07:47:46.177351+0000","last_became_active":"2024-09-10T07:47:31.862671+0000","last_became_peered":"2024-09-10T07:47:31.862671+0000","last_unstale":"2024-09-10T07:47:46.177351+0000","last_undegraded":"2024-09-10T07:47:46.177351+0000","last_fullsized":"2024-09-10T07:47:46.177351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:54.858623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.174440+0000","last_change":"2024-09-10T07:47:29.861345+0000","last_active":"2024-09-10T07:47:46.174440+0000","last_peered":"2024-09-10T07:47:46.174440+0000","last_clean":"2024-09-10T07:47:46.174440+0000","last_became_active":"2024-09-10T07:47:29.860987+0000","last_became_peered":"2024-09-10T07:47:29.860987+0000","last_unstale":"2024-09-10T07:47:46.174440+0000","last_undegraded":"2024-09-10T07:47:46.174440+0000","last_fullsized":"2024-09-10T07:47:46.174440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:33.202676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176992+0000","last_change":"2024-09-10T07:47:31.861217+0000","last_active":"2024-09-10T07:47:46.176992+0000","last_peered":"2024-09-10T07:47:46.176992+0000","last_clean":"2024-09-10T07:47:46.176992+0000","last_became_active":"2024-09-10T07:47:31.860572+0000","last_became_peered":"2024-09-10T07:47:31.860572+0000","last_unstale":"2024-09-10T07:47:46.176992+0000","last_undegraded":"2024-09-10T07:47:46.176992+0000","last_fullsized":"2024-09-10T07:47:46.176992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:39.537642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.179624+0000","last_change":"2024-09-10T07:47:29.855256+0000","last_active":"2024-09-10T07:47:46.179624+0000","last_peered":"2024-09-10T07:47:46.179624+0000","last_clean":"2024-09-10T07:47:46.179624+0000","last_became_active":"2024-09-10T07:47:29.854922+0000","last_became_peered":"2024-09-10T07:47:29.854922+0000","last_unstale":"2024-09-10T07:47:46.179624+0000","last_undegraded":"2024-09-10T07:47:46.179624+0000","last_fullsized":"2024-09-10T07:47:46.179624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:44.264077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.192868+0000","last_change":"2024-09-10T07:47:31.866057+0000","last_active":"2024-09-10T07:47:46.192868+0000","last_peered":"2024-09-10T07:47:46.192868+0000","last_clean":"2024-09-10T07:47:46.192868+0000","last_became_active":"2024-09-10T07:47:31.865696+0000","last_became_peered":"2024-09-10T07:47:31.865696+0000","last_unstale":"2024-09-10T07:47:46.192868+0000","last_undegraded":"2024-09-10T07:47:46.192868+0000","last_fullsized":"2024-09-10T07:47:46.192868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:31.904881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:54.128173+0000","last_change":"2024-09-10T07:47:29.853800+0000","last_active":"2024-09-10T07:47:54.128173+0000","last_peered":"2024-09-10T07:47:54.128173+0000","last_clean":"2024-09-10T07:47:54.128173+0000","last_became_active":"2024-09-10T07:47:29.853480+0000","last_became_peered":"2024-09-10T07:47:29.853480+0000","last_unstale":"2024-09-10T07:47:54.128173+0000","last_undegraded":"2024-09-10T07:47:54.128173+0000","last_fullsized":"2024-09-10T07:47:54.128173+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:31.683236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173078+0000","last_change":"2024-09-10T07:47:31.864686+0000","last_active":"2024-09-10T07:47:46.173078+0000","last_peered":"2024-09-10T07:47:46.173078+0000","last_clean":"2024-09-10T07:47:46.173078+0000","last_became_active":"2024-09-10T07:47:31.864188+0000","last_became_peered":"2024-09-10T07:47:31.864188+0000","last_unstale":"2024-09-10T07:47:46.173078+0000","last_undegraded":"2024-09-10T07:47:46.173078+0000","last_fullsized":"2024-09-10T07:47:46.173078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:15.838121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.193128+0000","last_change":"2024-09-10T07:47:30.089172+0000","last_active":"2024-09-10T07:47:46.193128+0000","last_peered":"2024-09-10T07:47:46.193128+0000","last_clean":"2024-09-10T07:47:46.193128+0000","last_became_active":"2024-09-10T07:47:30.088859+0000","last_became_peered":"2024-09-10T07:47:30.088859+0000","last_unstale":"2024-09-10T07:47:46.193128+0000","last_undegraded":"2024-09-10T07:47:46.193128+0000","last_fullsized":"2024-09-10T07:47:46.193128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:22.415581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176427+0000","last_change":"2024-09-10T07:47:31.863676+0000","last_active":"2024-09-10T07:47:46.176427+0000","last_peered":"2024-09-10T07:47:46.176427+0000","last_clean":"2024-09-10T07:47:46.176427+0000","last_became_active":"2024-09-10T07:47:31.863399+0000","last_became_peered":"2024-09-10T07:47:31.863399+0000","last_unstale":"2024-09-10T07:47:46.176427+0000","last_undegraded":"2024-09-10T07:47:46.176427+0000","last_fullsized":"2024-09-10T07:47:46.176427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:40.168078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172713+0000","last_change":"2024-09-10T07:47:29.862578+0000","last_active":"2024-09-10T07:47:46.172713+0000","last_peered":"2024-09-10T07:47:46.172713+0000","last_clean":"2024-09-10T07:47:46.172713+0000","last_became_active":"2024-09-10T07:47:29.862157+0000","last_became_peered":"2024-09-10T07:47:29.862157+0000","last_unstale":"2024-09-10T07:47:46.172713+0000","last_undegraded":"2024-09-10T07:47:46.172713+0000","last_fullsized":"2024-09-10T07:47:46.172713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:47.201556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176894+0000","last_change":"2024-09-10T07:47:31.865766+0000","last_active":"2024-09-10T07:47:46.176894+0000","last_peered":"2024-09-10T07:47:46.176894+0000","last_clean":"2024-09-10T07:47:46.176894+0000","last_became_active":"2024-09-10T07:47:31.865416+0000","last_became_peered":"2024-09-10T07:47:31.865416+0000","last_unstale":"2024-09-10T07:47:46.176894+0000","last_undegraded":"2024-09-10T07:47:46.176894+0000","last_fullsized":"2024-09-10T07:47:46.176894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.274836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.171982+0000","last_change":"2024-09-10T07:47:29.856768+0000","last_active":"2024-09-10T07:47:46.171982+0000","last_peered":"2024-09-10T07:47:46.171982+0000","last_clean":"2024-09-10T07:47:46.171982+0000","last_became_active":"2024-09-10T07:47:29.856457+0000","last_became_peered":"2024-09-10T07:47:29.856457+0000","last_unstale":"2024-09-10T07:47:46.171982+0000","last_undegraded":"2024-09-10T07:47:46.171982+0000","last_fullsized":"2024-09-10T07:47:46.171982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:17.227156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173830+0000","last_change":"2024-09-10T07:47:31.865457+0000","last_active":"2024-09-10T07:47:46.173830+0000","last_peered":"2024-09-10T07:47:46.173830+0000","last_clean":"2024-09-10T07:47:46.173830+0000","last_became_active":"2024-09-10T07:47:31.864801+0000","last_became_peered":"2024-09-10T07:47:31.864801+0000","last_unstale":"2024-09-10T07:47:46.173830+0000","last_undegraded":"2024-09-10T07:47:46.173830+0000","last_fullsized":"2024-09-10T07:47:46.173830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:59.236321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.182025+0000","last_change":"2024-09-10T07:47:46.180534+0000","last_active":"2024-09-10T07:47:46.182025+0000","last_peered":"2024-09-10T07:47:46.182025+0000","last_clean":"2024-09-10T07:47:46.182025+0000","last_became_active":"2024-09-10T07:47:46.180067+0000","last_became_peered":"2024-09-10T07:47:46.180067+0000","last_unstale":"2024-09-10T07:47:46.182025+0000","last_undegraded":"2024-09-10T07:47:46.182025+0000","last_fullsized":"2024-09-10T07:47:46.182025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:39.221934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172418+0000","last_change":"2024-09-10T07:47:31.864617+0000","last_active":"2024-09-10T07:47:46.172418+0000","last_peered":"2024-09-10T07:47:46.172418+0000","last_clean":"2024-09-10T07:47:46.172418+0000","last_became_active":"2024-09-10T07:47:31.864284+0000","last_became_peered":"2024-09-10T07:47:31.864284+0000","last_unstale":"2024-09-10T07:47:46.172418+0000","last_undegraded":"2024-09-10T07:47:46.172418+0000","last_fullsized":"2024-09-10T07:47:46.172418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:31.406445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.185054+0000","last_change":"2024-09-10T07:47:46.184591+0000","last_active":"2024-09-10T07:47:46.185054+0000","last_peered":"2024-09-10T07:47:46.185054+0000","last_clean":"2024-09-10T07:47:46.185054+0000","last_became_active":"2024-09-10T07:47:46.179474+0000","last_became_peered":"2024-09-10T07:47:46.179474+0000","last_unstale":"2024-09-10T07:47:46.185054+0000","last_undegraded":"2024-09-10T07:47:46.185054+0000","last_fullsized":"2024-09-10T07:47:46.185054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:02.752937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173972+0000","last_change":"2024-09-10T07:47:31.869921+0000","last_active":"2024-09-10T07:47:46.173972+0000","last_peered":"2024-09-10T07:47:46.173972+0000","last_clean":"2024-09-10T07:47:46.173972+0000","last_became_active":"2024-09-10T07:47:31.869602+0000","last_became_peered":"2024-09-10T07:47:31.869602+0000","last_unstale":"2024-09-10T07:47:46.173972+0000","last_undegraded":"2024-09-10T07:47:46.173972+0000","last_fullsized":"2024-09-10T07:47:46.173972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:50.590335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.181800+0000","last_change":"2024-09-10T07:47:46.181800+0000","last_active":"2024-09-10T07:47:46.181800+0000","last_peered":"2024-09-10T07:47:46.181800+0000","last_clean":"2024-09-10T07:47:46.181800+0000","last_became_active":"2024-09-10T07:47:46.181358+0000","last_became_peered":"2024-09-10T07:47:46.181358+0000","last_unstale":"2024-09-10T07:47:46.181800+0000","last_undegraded":"2024-09-10T07:47:46.181800+0000","last_fullsized":"2024-09-10T07:47:46.181800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:23.311525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.178303+0000","last_change":"2024-09-10T07:47:29.862301+0000","last_active":"2024-09-10T07:47:46.178303+0000","last_peered":"2024-09-10T07:47:46.178303+0000","last_clean":"2024-09-10T07:47:46.178303+0000","last_became_active":"2024-09-10T07:47:29.861113+0000","last_became_peered":"2024-09-10T07:47:29.861113+0000","last_unstale":"2024-09-10T07:47:46.178303+0000","last_undegraded":"2024-09-10T07:47:46.178303+0000","last_fullsized":"2024-09-10T07:47:46.178303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:14.923430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172699+0000","last_change":"2024-09-10T07:47:31.871097+0000","last_active":"2024-09-10T07:47:46.172699+0000","last_peered":"2024-09-10T07:47:46.172699+0000","last_clean":"2024-09-10T07:47:46.172699+0000","last_became_active":"2024-09-10T07:47:31.869399+0000","last_became_peered":"2024-09-10T07:47:31.869399+0000","last_unstale":"2024-09-10T07:47:46.172699+0000","last_undegraded":"2024-09-10T07:47:46.172699+0000","last_fullsized":"2024-09-10T07:47:46.172699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:07.967838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.186555+0000","last_change":"2024-09-10T07:47:46.186555+0000","last_active":"2024-09-10T07:47:46.186555+0000","last_peered":"2024-09-10T07:47:46.186555+0000","last_clean":"2024-09-10T07:47:46.186555+0000","last_became_active":"2024-09-10T07:47:46.182966+0000","last_became_peered":"2024-09-10T07:47:46.182966+0000","last_unstale":"2024-09-10T07:47:46.186555+0000","last_undegraded":"2024-09-10T07:47:46.186555+0000","last_fullsized":"2024-09-10T07:47:46.186555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:32.435739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.176715+0000","last_change":"2024-09-10T07:47:31.873450+0000","last_active":"2024-09-10T07:47:46.176715+0000","last_peered":"2024-09-10T07:47:46.176715+0000","last_clean":"2024-09-10T07:47:46.176715+0000","last_became_active":"2024-09-10T07:47:31.873134+0000","last_became_peered":"2024-09-10T07:47:31.873134+0000","last_unstale":"2024-09-10T07:47:46.176715+0000","last_undegraded":"2024-09-10T07:47:46.176715+0000","last_fullsized":"2024-09-10T07:47:46.176715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:19.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.173185+0000","last_change":"2024-09-10T07:47:29.861395+0000","last_active":"2024-09-10T07:47:46.173185+0000","last_peered":"2024-09-10T07:47:46.173185+0000","last_clean":"2024-09-10T07:47:46.173185+0000","last_became_active":"2024-09-10T07:47:29.861002+0000","last_became_peered":"2024-09-10T07:47:29.861002+0000","last_unstale":"2024-09-10T07:47:46.173185+0000","last_undegraded":"2024-09-10T07:47:46.173185+0000","last_fullsized":"2024-09-10T07:47:46.173185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:59.347663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.172934+0000","last_change":"2024-09-10T07:47:31.872400+0000","last_active":"2024-09-10T07:47:46.172934+0000","last_peered":"2024-09-10T07:47:46.172934+0000","last_clean":"2024-09-10T07:47:46.172934+0000","last_became_active":"2024-09-10T07:47:31.871995+0000","last_became_peered":"2024-09-10T07:47:31.871995+0000","last_unstale":"2024-09-10T07:47:46.172934+0000","last_undegraded":"2024-09-10T07:47:46.172934+0000","last_fullsized":"2024-09-10T07:47:46.172934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:30.845943+0000","last_clean_scrub_stamp":"2024-09-10T07:47:30.845943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:51.421387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:47:46.198560+0000","last_change":"2024-09-10T07:47:46.198560+0000","last_active":"2024-09-10T07:47:46.198560+0000","last_peered":"2024-09-10T07:47:46.198560+0000","last_clean":"2024-09-10T07:47:46.198560+0000","last_became_active":"2024-09-10T07:47:46.194070+0000","last_became_peered":"2024-09-10T07:47:46.194070+0000","last_unstale":"2024-09-10T07:47:46.198560+0000","last_undegraded":"2024-09-10T07:47:46.198560+0000","last_fullsized":"2024-09-10T07:47:46.198560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:47:28.842468+0000","last_clean_scrub_stamp":"2024-09-10T07:47:28.842468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:03.590728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":108,"num_read_kb":116,"num_write":83,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547225,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":441646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808861,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1589248,"data_stored":1095144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":442228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":441668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1032713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":441763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1032313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":442250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":504499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":504465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":441736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T07:48:34.878 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T07:48:34.879 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T07:48:34.879 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T07:48:34.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T07:48:35.127 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.586+0000 7f06c83ad640 1 -- 172.21.15.73:0/1715903676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102570 msgr2=0x7f06c01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1715903676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102570 0x7f06c01029b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009900 tx=0x7f06b002a480 comp rx=0 tx=0).stop 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 -- 172.21.15.73:0/1715903676 shutdown_connections 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1715903676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c0102ef0 0x7f06c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1715903676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102570 0x7f06c01029b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1715903676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c0100e20 0x7f06c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 -- 172.21.15.73:0/1715903676 >> 172.21.15.73:0/1715903676 conn(0x7f06c00fc7d0 msgr2=0x7f06c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 -- 172.21.15.73:0/1715903676 shutdown_connections 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 -- 172.21.15.73:0/1715903676 wait complete. 2024-09-10T07:48:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 Processor -- start 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.587+0000 7f06c83ad640 1 -- start start 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c83ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c0100e20 0x7f06c0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c83ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c0102570 0x7f06c0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c83ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102ef0 0x7f06c019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c83ad640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01120c0 con 0x7f06c0102ef0 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c83ad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0111f40 con 0x7f06c0100e20 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c83ad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0112240 con 0x7f06c0102570 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c694a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102ef0 0x7f06c019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c694a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102ef0 0x7f06c019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58924/0 (socket says 172.21.15.73:58924) 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c694a640 1 -- 172.21.15.73:0/1137316326 learned_addr learned my addr 172.21.15.73:0/1137316326 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c5948640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c0102570 0x7f06c0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c6149640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c0100e20 0x7f06c0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c694a640 1 -- 172.21.15.73:0/1137316326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c0102570 msgr2=0x7f06c0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c694a640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c0102570 0x7f06c0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c694a640 1 -- 172.21.15.73:0/1137316326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c0100e20 msgr2=0x7f06c0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c694a640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c0100e20 0x7f06c0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c694a640 1 -- 172.21.15.73:0/1137316326 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c019d530 con 0x7f06c0102ef0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c694a640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102ef0 0x7f06c019ce50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f06b800cad0 tx=0x7f06b800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06b77fe640 1 -- 172.21.15.73:0/1137316326 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b800ad60 con 0x7f06c0102ef0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c019d820 con 0x7f06c0102ef0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.588+0000 7f06b77fe640 1 -- 172.21.15.73:0/1137316326 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06b8005020 con 0x7f06c0102ef0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.589+0000 7f06b77fe640 1 -- 172.21.15.73:0/1137316326 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b800f6b0 con 0x7f06c0102ef0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.589+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c01a5100 con 0x7f06c0102ef0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.590+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c0101200 con 0x7f06c0102ef0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.591+0000 7f06b77fe640 1 -- 172.21.15.73:0/1137316326 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f06b8005560 con 0x7f06c0102ef0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.591+0000 7f06b77fe640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f06ac0a2c10 0x7f06ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.591+0000 7f06c6149640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f06ac0a2c10 0x7f06ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.591+0000 7f06b77fe640 1 -- 172.21.15.73:0/1137316326 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f06b80cf190 con 0x7f06c0102ef0 2024-09-10T07:48:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.592+0000 7f06c6149640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f06ac0a2c10 0x7f06ac0a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009990 tx=0x7f06bc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.595+0000 7f06b77fe640 1 -- 172.21.15.73:0/1137316326 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06b8014030 con 0x7f06c0102ef0 2024-09-10T07:48:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.802+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f06c0109090 con 0x7f06c0102ef0 2024-09-10T07:48:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.802+0000 7f06b77fe640 1 -- 172.21.15.73:0/1137316326 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f06b809bf70 con 0x7f06c0102ef0 2024-09-10T07:48:35.802 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:35.802 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T07:48:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.804+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f06ac0a2c10 msgr2=0x7f06ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.804+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f06ac0a2c10 0x7f06ac0a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009990 tx=0x7f06bc009110 comp rx=0 tx=0).stop 2024-09-10T07:48:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.804+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102ef0 msgr2=0x7f06c019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.804+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102ef0 0x7f06c019ce50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f06b800cad0 tx=0x7f06b800ced0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.804+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 shutdown_connections 2024-09-10T07:48:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.804+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f06ac0a2c10 0x7f06ac0a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.804+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c0102ef0 0x7f06c019ce50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.804+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c0102570 0x7f06c0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.805+0000 7f06c83ad640 1 --2- 172.21.15.73:0/1137316326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c0100e20 0x7f06c0198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.805+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 >> 172.21.15.73:0/1137316326 conn(0x7f06c00fc7d0 msgr2=0x7f06c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.805+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 shutdown_connections 2024-09-10T07:48:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:35.805+0000 7f06c83ad640 1 -- 172.21.15.73:0/1137316326 wait complete. 2024-09-10T07:48:36.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:35 smithi102 ceph-mon[35514]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:48:36.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:35 smithi102 ceph-mon[35514]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:36.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:35 smithi159 ceph-mon[35522]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:48:36.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:35 smithi159 ceph-mon[35522]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:36.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:35 smithi073 ceph-mon[30850]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T07:48:36.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:35 smithi073 ceph-mon[30850]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:36.598 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T07:48:36.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:48:36.847 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:36.968 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:36 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1137316326' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T07:48:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:36 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1137316326' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T07:48:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:36 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1137316326' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T07:48:37.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.327+0000 7f290a99b640 1 -- 172.21.15.73:0/2616079789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904102d40 msgr2=0x7f2904103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.327+0000 7f290a99b640 1 --2- 172.21.15.73:0/2616079789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904102d40 0x7f2904103120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009900 tx=0x7f28f402a480 comp rx=0 tx=0).stop 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.327+0000 7f290a99b640 1 -- 172.21.15.73:0/2616079789 shutdown_connections 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.327+0000 7f290a99b640 1 --2- 172.21.15.73:0/2616079789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f290410c170 0x7f290410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.327+0000 7f290a99b640 1 --2- 172.21.15.73:0/2616079789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2904103660 0x7f290410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.327+0000 7f290a99b640 1 --2- 172.21.15.73:0/2616079789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904102d40 0x7f2904103120 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.327+0000 7f290a99b640 1 -- 172.21.15.73:0/2616079789 >> 172.21.15.73:0/2616079789 conn(0x7f29040fc7a0 msgr2=0x7f29040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.327+0000 7f290a99b640 1 -- 172.21.15.73:0/2616079789 shutdown_connections 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.327+0000 7f290a99b640 1 -- 172.21.15.73:0/2616079789 wait complete. 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f290a99b640 1 Processor -- start 2024-09-10T07:48:37.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f290a99b640 1 -- start start 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f290a99b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2904102d40 0x7f29041984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f290a99b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904103660 0x7f2904198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f290a99b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f290410c170 0x7f290419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f290a99b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2904111f70 con 0x7f2904103660 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f290a99b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2904111df0 con 0x7f290410c170 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f290a99b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f29041120f0 con 0x7f2904102d40 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f29037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904103660 0x7f2904198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f29037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904103660 0x7f2904198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58946/0 (socket says 172.21.15.73:58946) 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f29037fe640 1 -- 172.21.15.73:0/3948657947 learned_addr learned my addr 172.21.15.73:0/3948657947 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f29037fe640 1 -- 172.21.15.73:0/3948657947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2904102d40 msgr2=0x7f29041984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f2903fff640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2904102d40 0x7f29041984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f29037fe640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2904102d40 0x7f29041984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f2908f38640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f290410c170 0x7f290419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f29037fe640 1 -- 172.21.15.73:0/3948657947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f290410c170 msgr2=0x7f290419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f29037fe640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f290410c170 0x7f290419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.328+0000 7f29037fe640 1 -- 172.21.15.73:0/3948657947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290419d480 con 0x7f2904103660 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.329+0000 7f29037fe640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904103660 0x7f2904198a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00d740 tx=0x7f28ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.329+0000 7f29017fa640 1 -- 172.21.15.73:0/3948657947 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec017070 con 0x7f2904103660 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.329+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290419d770 con 0x7f2904103660 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.329+0000 7f29017fa640 1 -- 172.21.15.73:0/3948657947 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28ec00de50 con 0x7f2904103660 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.329+0000 7f29017fa640 1 -- 172.21.15.73:0/3948657947 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00f620 con 0x7f2904103660 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.329+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29041a5050 con 0x7f2904103660 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.330+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2904103120 con 0x7f2904103660 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.331+0000 7f29017fa640 1 -- 172.21.15.73:0/3948657947 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f28ec009c30 con 0x7f2904103660 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.331+0000 7f29017fa640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f28f00a2c10 0x7f28f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:37.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.332+0000 7f2903fff640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f28f00a2c10 0x7f28f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:37.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.332+0000 7f29017fa640 1 -- 172.21.15.73:0/3948657947 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f28ec0ceea0 con 0x7f2904103660 2024-09-10T07:48:37.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.332+0000 7f2903fff640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f28f00a2c10 0x7f28f00a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28f40096c0 tx=0x7f28f4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:37.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.336+0000 7f29017fa640 1 -- 172.21.15.73:0/3948657947 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28ec09bc80 con 0x7f2904103660 2024-09-10T07:48:37.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.536+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2904107270 con 0x7f2904103660 2024-09-10T07:48:37.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.537+0000 7f29017fa640 1 -- 172.21.15.73:0/3948657947 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11853 (secure 0 0 0) 0x7f28ec09b580 con 0x7f2904103660 2024-09-10T07:48:37.538 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:37.538 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"btime":"2024-09-10T07:47:42:148674+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T07:47:32.394994+0000","modified":"2024-09-10T07:47:41.846317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6839/330469529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":330469529},{"type":"v1","addr":"172.21.15.102:6839","nonce":330469529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-10T07:48:37.538 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f28f00a2c10 msgr2=0x7f28f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f28f00a2c10 0x7f28f00a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28f40096c0 tx=0x7f28f4000bc0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904103660 msgr2=0x7f2904198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904103660 0x7f2904198a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00d740 tx=0x7f28ec00dc00 comp rx=0 tx=0).stop 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 shutdown_connections 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f28f00a2c10 0x7f28f00a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f290410c170 0x7f290419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2904103660 0x7f2904198a10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 --2- 172.21.15.73:0/3948657947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2904102d40 0x7f29041984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 >> 172.21.15.73:0/3948657947 conn(0x7f29040fc7a0 msgr2=0x7f29040fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 shutdown_connections 2024-09-10T07:48:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:37.539+0000 7f290a99b640 1 -- 172.21.15.73:0/3948657947 wait complete. 2024-09-10T07:48:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:37 smithi102 ceph-mon[35514]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:38.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:37 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3948657947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:38.156 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:37 smithi159 ceph-mon[35522]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:38.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:37 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3948657947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:38.160 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:37 smithi073 ceph-mon[30850]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:38.160 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:37 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3948657947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:38.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:48:38.434 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:38.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/1694507601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 msgr2=0x7f6bf4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:38.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/1694507601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 0x7f6bf4106e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009930 tx=0x7f6bf002a420 comp rx=0 tx=0).stop 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/1694507601 shutdown_connections 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/1694507601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4101420 0x7f6bf410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/1694507601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf4100a80 0x7f6bf4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/1694507601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 0x7f6bf4106e60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/1694507601 >> 172.21.15.73:0/1694507601 conn(0x7f6bf40fc7a0 msgr2=0x7f6bf40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/1694507601 shutdown_connections 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/1694507601 wait complete. 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 Processor -- start 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 -- start start 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.893+0000 7f6bfc5ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4100a80 0x7f6bf4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfc5ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf4101420 0x7f6bf41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfc5ff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 0x7f6bf41a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfc5ff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4110e80 con 0x7f6bf4106a80 2024-09-10T07:48:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfc5ff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4110d00 con 0x7f6bf4100a80 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfc5ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4111000 con 0x7f6bf4101420 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfab9c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 0x7f6bf41a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfab9c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 0x7f6bf41a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58964/0 (socket says 172.21.15.73:58964) 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfab9c640 1 -- 172.21.15.73:0/2752871915 learned_addr learned my addr 172.21.15.73:0/2752871915 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfa39b640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4100a80 0x7f6bf4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bf9b9a640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf4101420 0x7f6bf41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfab9c640 1 -- 172.21.15.73:0/2752871915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf4101420 msgr2=0x7f6bf41997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfab9c640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf4101420 0x7f6bf41997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfab9c640 1 -- 172.21.15.73:0/2752871915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4100a80 msgr2=0x7f6bf4199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfab9c640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4100a80 0x7f6bf4199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfab9c640 1 -- 172.21.15.73:0/2752871915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf41a4830 con 0x7f6bf4106a80 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfab9c640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 0x7f6bf41a42f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00cce0 tx=0x7f6bec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6beb7fe640 1 -- 172.21.15.73:0/2752871915 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00f450 con 0x7f6bf4106a80 2024-09-10T07:48:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf41a4a00 con 0x7f6bf4106a80 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6beb7fe640 1 -- 172.21.15.73:0/2752871915 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bec00fad0 con 0x7f6bf4106a80 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6beb7fe640 1 -- 172.21.15.73:0/2752871915 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec018c10 con 0x7f6bf4106a80 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.894+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf41a4f10 con 0x7f6bf4106a80 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.895+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf4100ee0 con 0x7f6bf4106a80 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.896+0000 7f6beb7fe640 1 -- 172.21.15.73:0/2752871915 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6bec00f5f0 con 0x7f6bf4106a80 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.897+0000 7f6beb7fe640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6be00a2c10 0x7f6be00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.897+0000 7f6bfa39b640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6be00a2c10 0x7f6be00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.897+0000 7f6beb7fe640 1 -- 172.21.15.73:0/2752871915 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f6bec0cf930 con 0x7f6bf4106a80 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.897+0000 7f6bfa39b640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6be00a2c10 0x7f6be00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0000c00 tx=0x7f6bf0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:38.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:38.900+0000 7f6beb7fe640 1 -- 172.21.15.73:0/2752871915 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6bec014030 con 0x7f6bf4106a80 2024-09-10T07:48:39.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.101+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bf406ad80 con 0x7f6bf4106a80 2024-09-10T07:48:39.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.102+0000 7f6beb7fe640 1 -- 172.21.15.73:0/2752871915 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11853 (secure 0 0 0) 0x7f6bf406ad80 con 0x7f6bf4106a80 2024-09-10T07:48:39.102 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:39.102 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"btime":"2024-09-10T07:47:42:148674+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T07:47:32.394994+0000","modified":"2024-09-10T07:47:41.846317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6839/330469529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":330469529},{"type":"v1","addr":"172.21.15.102:6839","nonce":330469529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-10T07:48:39.102 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6be00a2c10 msgr2=0x7f6be00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6be00a2c10 0x7f6be00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0000c00 tx=0x7f6bf0005a20 comp rx=0 tx=0).stop 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 msgr2=0x7f6bf41a42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 0x7f6bf41a42f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00cce0 tx=0x7f6bec00a620 comp rx=0 tx=0).stop 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 shutdown_connections 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f6be00a2c10 0x7f6be00a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bf4106a80 0x7f6bf41a42f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf4101420 0x7f6bf41997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 --2- 172.21.15.73:0/2752871915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4100a80 0x7f6bf4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 >> 172.21.15.73:0/2752871915 conn(0x7f6bf40fc7a0 msgr2=0x7f6bf40fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 shutdown_connections 2024-09-10T07:48:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:39.104+0000 7f6bfc5ff640 1 -- 172.21.15.73:0/2752871915 wait complete. 2024-09-10T07:48:39.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T07:48:40.015 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:40.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:39 smithi102 ceph-mon[35514]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:40.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:39 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2752871915' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:40.135 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:39 smithi073 ceph-mon[30850]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:40.135 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:39 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2752871915' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:40.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:39 smithi159 ceph-mon[35522]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:40.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:39 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2752871915' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:40.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.601+0000 7fe392d9b640 1 -- 172.21.15.73:0/22148228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c101de0 msgr2=0x7fe38c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:40.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.601+0000 7fe392d9b640 1 --2- 172.21.15.73:0/22148228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c101de0 0x7fe38c1021c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe380009900 tx=0x7fe38002a410 comp rx=0 tx=0).stop 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.601+0000 7fe392d9b640 1 -- 172.21.15.73:0/22148228 shutdown_connections 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.601+0000 7fe392d9b640 1 --2- 172.21.15.73:0/22148228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe38c106f10 0x7fe38c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.601+0000 7fe392d9b640 1 --2- 172.21.15.73:0/22148228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c102790 0x7fe38c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.601+0000 7fe392d9b640 1 --2- 172.21.15.73:0/22148228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c101de0 0x7fe38c1021c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.601+0000 7fe392d9b640 1 -- 172.21.15.73:0/22148228 >> 172.21.15.73:0/22148228 conn(0x7fe38c0fd8c0 msgr2=0x7fe38c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.601+0000 7fe392d9b640 1 -- 172.21.15.73:0/22148228 shutdown_connections 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.601+0000 7fe392d9b640 1 -- 172.21.15.73:0/22148228 wait complete. 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe392d9b640 1 Processor -- start 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe392d9b640 1 -- start start 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe392d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c101de0 0x7fe38c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe392d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe38c102790 0x7fe38c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe392d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c106f10 0x7fe38c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:40.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe392d9b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c111f30 con 0x7fe38c106f10 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe392d9b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c111db0 con 0x7fe38c101de0 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe392d9b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c1120b0 con 0x7fe38c102790 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe391338640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c106f10 0x7fe38c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe391338640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c106f10 0x7fe38c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47140/0 (socket says 172.21.15.73:47140) 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe391338640 1 -- 172.21.15.73:0/2953894996 learned_addr learned my addr 172.21.15.73:0/2953894996 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe390b37640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c101de0 0x7fe38c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe38bfff640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe38c102790 0x7fe38c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe391338640 1 -- 172.21.15.73:0/2953894996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe38c102790 msgr2=0x7fe38c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe391338640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe38c102790 0x7fe38c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe391338640 1 -- 172.21.15.73:0/2953894996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c101de0 msgr2=0x7fe38c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe391338640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c101de0 0x7fe38c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.602+0000 7fe391338640 1 -- 172.21.15.73:0/2953894996 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c19d3f0 con 0x7fe38c106f10 2024-09-10T07:48:40.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.603+0000 7fe38bfff640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe38c102790 0x7fe38c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:40.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.603+0000 7fe391338640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c106f10 0x7fe38c19cd10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe38400cad0 tx=0x7fe38400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:40.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.603+0000 7fe389ffb640 1 -- 172.21.15.73:0/2953894996 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38400ae20 con 0x7fe38c106f10 2024-09-10T07:48:40.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.603+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38c19d6e0 con 0x7fe38c106f10 2024-09-10T07:48:40.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.603+0000 7fe389ffb640 1 -- 172.21.15.73:0/2953894996 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe384005020 con 0x7fe38c106f10 2024-09-10T07:48:40.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.603+0000 7fe389ffb640 1 -- 172.21.15.73:0/2953894996 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38400f6f0 con 0x7fe38c106f10 2024-09-10T07:48:40.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.603+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38c1a4fc0 con 0x7fe38c106f10 2024-09-10T07:48:40.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.604+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38c1021c0 con 0x7fe38c106f10 2024-09-10T07:48:40.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.605+0000 7fe389ffb640 1 -- 172.21.15.73:0/2953894996 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe3840051d0 con 0x7fe38c106f10 2024-09-10T07:48:40.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.606+0000 7fe389ffb640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe37c0a2c10 0x7fe37c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:40.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.606+0000 7fe390b37640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe37c0a2c10 0x7fe37c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:40.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.606+0000 7fe389ffb640 1 -- 172.21.15.73:0/2953894996 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe3840cf220 con 0x7fe38c106f10 2024-09-10T07:48:40.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.606+0000 7fe390b37640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe37c0a2c10 0x7fe37c0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe380009230 tx=0x7fe3800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:40.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.610+0000 7fe389ffb640 1 -- 172.21.15.73:0/2953894996 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe384014030 con 0x7fe38c106f10 2024-09-10T07:48:40.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.778+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe38c10a150 con 0x7fe38c106f10 2024-09-10T07:48:40.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.779+0000 7fe389ffb640 1 -- 172.21.15.73:0/2953894996 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22859 (secure 0 0 0) 0x7fe38409c000 con 0x7fe38c106f10 2024-09-10T07:48:40.779 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:40.779 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":83,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:47:46.168838+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:47:28.792230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:47:30.666653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:48:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.781+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe37c0a2c10 msgr2=0x7fe37c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.781+0000 7fe392d9b640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe37c0a2c10 0x7fe37c0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe380009230 tx=0x7fe3800058d0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c106f10 msgr2=0x7fe38c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c106f10 0x7fe38c19cd10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe38400cad0 tx=0x7fe38400cf90 comp rx=0 tx=0).stop 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 shutdown_connections 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe37c0a2c10 0x7fe37c0a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe38c106f10 0x7fe38c19cd10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe38c102790 0x7fe38c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 --2- 172.21.15.73:0/2953894996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c101de0 0x7fe38c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 >> 172.21.15.73:0/2953894996 conn(0x7fe38c0fd8c0 msgr2=0x7fe38c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 shutdown_connections 2024-09-10T07:48:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:40.782+0000 7fe392d9b640 1 -- 172.21.15.73:0/2953894996 wait complete. 2024-09-10T07:48:41.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:40 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2953894996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:48:41.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:40 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2953894996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:48:41.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:40 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2953894996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:48:41.464 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:48:41.718 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:42.062 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:41 smithi073 ceph-mon[30850]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:42.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:41 smithi102 ceph-mon[35514]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.145+0000 7f1220d2f640 1 -- 172.21.15.73:0/2828808233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1036e0 msgr2=0x7f121c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.145+0000 7f1220d2f640 1 --2- 172.21.15.73:0/2828808233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1036e0 0x7f121c107b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1210009930 tx=0x7f121002a420 comp rx=0 tx=0).stop 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.145+0000 7f1220d2f640 1 -- 172.21.15.73:0/2828808233 shutdown_connections 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.145+0000 7f1220d2f640 1 --2- 172.21.15.73:0/2828808233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c1082a0 0x7f121c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.145+0000 7f1220d2f640 1 --2- 172.21.15.73:0/2828808233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1036e0 0x7f121c107b90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.145+0000 7f1220d2f640 1 --2- 172.21.15.73:0/2828808233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f121c102d30 0x7f121c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.145+0000 7f1220d2f640 1 -- 172.21.15.73:0/2828808233 >> 172.21.15.73:0/2828808233 conn(0x7f121c0fc7d0 msgr2=0x7f121c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.145+0000 7f1220d2f640 1 -- 172.21.15.73:0/2828808233 shutdown_connections 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.145+0000 7f1220d2f640 1 -- 172.21.15.73:0/2828808233 wait complete. 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f1220d2f640 1 Processor -- start 2024-09-10T07:48:42.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f1220d2f640 1 -- start start 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f1220d2f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c102d30 0x7f121c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f1220d2f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c1036e0 0x7f121c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f1220d2f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f121c1082a0 0x7f121c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f1220d2f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f121c112060 con 0x7f121c102d30 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f1220d2f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f121c111ee0 con 0x7f121c1036e0 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f1220d2f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f121c1121e0 con 0x7f121c1082a0 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f121a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c102d30 0x7f121c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f121a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c102d30 0x7f121c198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47150/0 (socket says 172.21.15.73:47150) 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f121a59c640 1 -- 172.21.15.73:0/4273165601 learned_addr learned my addr 172.21.15.73:0/4273165601 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:42.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f1219d9b640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c1036e0 0x7f121c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f121a59c640 1 -- 172.21.15.73:0/4273165601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f121c1082a0 msgr2=0x7f121c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f121a59c640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f121c1082a0 0x7f121c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f121a59c640 1 -- 172.21.15.73:0/4273165601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c1036e0 msgr2=0x7f121c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f121a59c640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c1036e0 0x7f121c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f121a59c640 1 -- 172.21.15.73:0/4273165601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121c19d4f0 con 0x7f121c102d30 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.146+0000 7f121a59c640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c102d30 0x7f121c198540 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c920 tx=0x7f120c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.147+0000 7f120b7fe640 1 -- 172.21.15.73:0/4273165601 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c007c70 con 0x7f121c102d30 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.147+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121c19d7e0 con 0x7f121c102d30 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.147+0000 7f120b7fe640 1 -- 172.21.15.73:0/4273165601 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f120c007e10 con 0x7f121c102d30 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.147+0000 7f120b7fe640 1 -- 172.21.15.73:0/4273165601 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c018890 con 0x7f121c102d30 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.147+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f121c1a50c0 con 0x7f121c102d30 2024-09-10T07:48:42.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.148+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121c103110 con 0x7f121c102d30 2024-09-10T07:48:42.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.149+0000 7f120b7fe640 1 -- 172.21.15.73:0/4273165601 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f120c018a50 con 0x7f121c102d30 2024-09-10T07:48:42.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.149+0000 7f120b7fe640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f12040a2c10 0x7f12040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:42.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.150+0000 7f1219d9b640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f12040a2c10 0x7f12040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:42.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.150+0000 7f120b7fe640 1 -- 172.21.15.73:0/4273165601 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f120c0cf3e0 con 0x7f121c102d30 2024-09-10T07:48:42.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.150+0000 7f1219d9b640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f12040a2c10 0x7f12040a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1210009900 tx=0x7f1210032d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:42.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.154+0000 7f120b7fe640 1 -- 172.21.15.73:0/4273165601 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f120c014030 con 0x7f121c102d30 2024-09-10T07:48:42.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:41 smithi159 ceph-mon[35522]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.362+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f121c10a2e0 con 0x7f121c102d30 2024-09-10T07:48:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.363+0000 7f120b7fe640 1 -- 172.21.15.73:0/4273165601 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11853 (secure 0 0 0) 0x7f120c09c1c0 con 0x7f121c102d30 2024-09-10T07:48:42.363 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:42.363 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"btime":"2024-09-10T07:47:42:148674+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T07:47:32.394994+0000","modified":"2024-09-10T07:47:41.846317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6839/330469529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":330469529},{"type":"v1","addr":"172.21.15.102:6839","nonce":330469529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-10T07:48:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-10T07:48:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f12040a2c10 msgr2=0x7f12040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f12040a2c10 0x7f12040a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1210009900 tx=0x7f1210032d10 comp rx=0 tx=0).stop 2024-09-10T07:48:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c102d30 msgr2=0x7f121c198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c102d30 0x7f121c198540 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c920 tx=0x7f120c00cde0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 shutdown_connections 2024-09-10T07:48:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f12040a2c10 0x7f12040a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f121c1082a0 0x7f121c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c1036e0 0x7f121c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 --2- 172.21.15.73:0/4273165601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c102d30 0x7f121c198540 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 >> 172.21.15.73:0/4273165601 conn(0x7f121c0fc7d0 msgr2=0x7f121c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 shutdown_connections 2024-09-10T07:48:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:42.366+0000 7f1220d2f640 1 -- 172.21.15.73:0/4273165601 wait complete. 2024-09-10T07:48:42.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:42 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4273165601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:42.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:42 smithi073 ceph-mon[30850]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:43.045 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T07:47:32.394994+0000', 'modified': '2024-09-10T07:47:41.846317+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6837/801459300', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 801459300}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 801459300}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.102:6839/330469529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 330469529}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 330469529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24485, 'qdb_cluster': [24485]} 2024-09-10T07:48:43.045 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:48:43.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T07:48:43.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:42 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/4273165601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:43.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:42 smithi102 ceph-mon[35514]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:43.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:42 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/4273165601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:43.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:42 smithi159 ceph-mon[35522]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:48:43.292 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.745+0000 7f517fcbf640 1 -- 172.21.15.73:0/4138532360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178106f10 msgr2=0x7f517810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.745+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4138532360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178106f10 0x7f517810ea90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5170009ca0 tx=0x7f517002a8c0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.745+0000 7f517fcbf640 1 -- 172.21.15.73:0/4138532360 shutdown_connections 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.745+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4138532360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178106f10 0x7f517810ea90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.745+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4138532360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5178102790 0x7f51781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.745+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4138532360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5178101de0 0x7f51781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.745+0000 7f517fcbf640 1 -- 172.21.15.73:0/4138532360 >> 172.21.15.73:0/4138532360 conn(0x7f51780fd8c0 msgr2=0x7f51780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.745+0000 7f517fcbf640 1 -- 172.21.15.73:0/4138532360 shutdown_connections 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.745+0000 7f517fcbf640 1 -- 172.21.15.73:0/4138532360 wait complete. 2024-09-10T07:48:43.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517fcbf640 1 Processor -- start 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517fcbf640 1 -- start start 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517fcbf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5178101de0 0x7f5178198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517fcbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178102790 0x7f5178198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517fcbf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5178106f10 0x7f517819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517fcbf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5178112010 con 0x7f5178102790 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517fcbf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5178111e90 con 0x7f5178106f10 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517fcbf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5178112190 con 0x7f5178101de0 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517d25a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178102790 0x7f5178198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517d25a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178102790 0x7f5178198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47170/0 (socket says 172.21.15.73:47170) 2024-09-10T07:48:43.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.746+0000 7f517d25a640 1 -- 172.21.15.73:0/4205398785 learned_addr learned my addr 172.21.15.73:0/4205398785 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517da5b640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5178101de0 0x7f5178198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517e25c640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5178106f10 0x7f517819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517d25a640 1 -- 172.21.15.73:0/4205398785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5178101de0 msgr2=0x7f5178198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517d25a640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5178101de0 0x7f5178198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517d25a640 1 -- 172.21.15.73:0/4205398785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5178106f10 msgr2=0x7f517819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517d25a640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5178106f10 0x7f517819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517d25a640 1 -- 172.21.15.73:0/4205398785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517819d540 con 0x7f5178102790 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517e25c640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5178106f10 0x7f517819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517d25a640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178102790 0x7f5178198ad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f516800b4a0 tx=0x7f516800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f516effd640 1 -- 172.21.15.73:0/4205398785 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168014070 con 0x7f5178102790 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517fcbf640 1 -- 172.21.15.73:0/4205398785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517819d830 con 0x7f5178102790 2024-09-10T07:48:43.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f516effd640 1 -- 172.21.15.73:0/4205398785 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5168010af0 con 0x7f5178102790 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f516effd640 1 -- 172.21.15.73:0/4205398785 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168017d10 con 0x7f5178102790 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.747+0000 7f517fcbf640 1 -- 172.21.15.73:0/4205398785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51781a5110 con 0x7f5178102790 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.749+0000 7f516effd640 1 -- 172.21.15.73:0/4205398785 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5168017070 con 0x7f5178102790 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f5182098740 1 Processor -- start 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f5182098740 1 -- start start 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f5182098740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dbefdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f5182098740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 0x55d72dbfa670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f5182098740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbfabb0 0x55d72dbfcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f5182098740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d72db56090 con 0x55d72dbef9d0 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f5182098740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d72dafda70 con 0x55d72dbfabb0 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f5182098740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d72db52050 con 0x55d72dbf02f0 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f516effd640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f51640a2c10 0x7f51640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f517e25c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dbefdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f517e25c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dbefdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47174/0 (socket says 172.21.15.73:47174) 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f517e25c640 1 -- 172.21.15.73:0/3512997846 learned_addr learned my addr 172.21.15.73:0/3512997846 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f517da5b640 1 --2- 172.21.15.73:0/3512997846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 0x55d72dbfa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f516effd640 1 -- 172.21.15.73:0/4205398785 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f51680ce560 con 0x7f5178102790 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f517e25c640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f51640a2c10 0x7f51640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.750+0000 7f517d25a640 1 --2- 172.21.15.73:0/3512997846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbfabb0 0x55d72dbfcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.751+0000 7f517e25c640 1 -- 172.21.15.73:0/3512997846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 msgr2=0x55d72dbfa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.751+0000 7f517e25c640 1 --2- 172.21.15.73:0/3512997846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 0x55d72dbfa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.751+0000 7f517e25c640 1 -- 172.21.15.73:0/3512997846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbfabb0 msgr2=0x55d72dbfcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.751+0000 7f517e25c640 1 --2- 172.21.15.73:0/3512997846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbfabb0 0x55d72dbfcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.751+0000 7f517e25c640 1 -- 172.21.15.73:0/3512997846 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d72db0a130 con 0x55d72dbef9d0 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.751+0000 7f517e25c640 1 --2- 172.21.15.73:0/3512997846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dbefdb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5170009dc0 tx=0x7f5170003ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d93004f45ac882 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:43.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.751+0000 7f5163fff640 1 -- 172.21.15.73:0/3512997846 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170004b40 con 0x55d72dbef9d0 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.751+0000 7f5163fff640 1 -- 172.21.15.73:0/3512997846 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f517004d070 con 0x55d72dbef9d0 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.751+0000 7f5163fff640 1 -- 172.21.15.73:0/3512997846 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517002f610 con 0x55d72dbef9d0 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 -- 172.21.15.73:0/3512997846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 msgr2=0x55d72dbefdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f517e25c640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f51640a2c10 0x7f51640a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f517004c000 tx=0x7f517004a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 --2- 172.21.15.73:0/3512997846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dbefdb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5170009dc0 tx=0x7f5170003ac0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 -- 172.21.15.73:0/3512997846 shutdown_connections 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 --2- 172.21.15.73:0/3512997846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbfabb0 0x55d72dbfcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 --2- 172.21.15.73:0/3512997846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 0x55d72dbfa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 --2- 172.21.15.73:0/3512997846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dbefdb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 -- 172.21.15.73:0/3512997846 >> 172.21.15.73:0/3512997846 conn(0x55d72dbebf60 msgr2=0x55d72dbec340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 -- 172.21.15.73:0/3512997846 shutdown_connections 2024-09-10T07:48:43.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 -- 172.21.15.73:0/3512997846 wait complete. 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 -- start start 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.752+0000 7f5182098740 1 Processor -- start 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f5182098740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 0x55d72dbfa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f5182098740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 0x55d72dbf77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f5182098740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbfabb0 0x55d72dbf7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f5182098740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d72dbfd780 con 0x55d72dbfabb0 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f5182098740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d72db10f20 con 0x55d72dbef9d0 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f5182098740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d72dbfd900 con 0x55d72dbf02f0 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f5182098740 10 client.0 _ll_register_callbacks cb 0x55d72dada030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517e25c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbfabb0 0x55d72dbf7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517e25c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbfabb0 0x55d72dbf7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47188/0 (socket says 172.21.15.73:47188) 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517e25c640 1 -- 172.21.15.73:0/2641456116 learned_addr learned my addr 172.21.15.73:0/2641456116 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:43.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517d25a640 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 0x55d72dbf77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517da5b640 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 0x55d72dbfa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517e25c640 1 -- 172.21.15.73:0/2641456116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 msgr2=0x55d72dbf77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517e25c640 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 0x55d72dbf77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517e25c640 1 -- 172.21.15.73:0/2641456116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 msgr2=0x55d72dbfa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517e25c640 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 0x55d72dbfa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517e25c640 1 -- 172.21.15.73:0/2641456116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d72d8c72b0 con 0x55d72dbfabb0 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f517e25c640 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbfabb0 0x55d72dbf7cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5170009830 tx=0x7f517002f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37be153661ce037 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f51617fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f51617fa640 1 -- 172.21.15.73:0/2641456116 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170060060 con 0x55d72dbfabb0 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f51617fa640 1 -- 172.21.15.73:0/2641456116 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f5170031820 con 0x55d72dbfabb0 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.753+0000 7f5182098740 1 -- 172.21.15.73:0/2641456116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f517004d070 con 0x55d72dbfabb0 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f51617fa640 1 -- 172.21.15.73:0/2641456116 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f517002f610 con 0x55d72dbfabb0 2024-09-10T07:48:43.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f5182098740 10 client.14958 fetch_fsmap learned FSMap version 19 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f5182098740 1 -- 172.21.15.73:0/2641456116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d72dbfd780 con 0x55d72dbfabb0 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f51617fa640 1 -- 172.21.15.73:0/2641456116 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f517004d070 con 0x55d72dbfabb0 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f51617fa640 1 -- 172.21.15.73:0/2641456116 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f517002fd00 con 0x55d72dbfabb0 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f5182098740 10 client.14958 fetch_fsmap finished waiting for FSMap version 19 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f5182098740 10 client.14958 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f5182098740 20 client.14958 populate_metadata read hostname 'smithi073' 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f5182098740 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55d72dc0b160 0x55d72dc0c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f5182098740 4 client.14958 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f5182098740 1 -- 172.21.15.73:0/2641456116 --> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d72db63600 con 0x55d72dc0b160 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.754+0000 7f517da5b640 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55d72dc0b160 0x55d72dc0c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.755+0000 7f517da5b640 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55d72dc0b160 0x55d72dc0c5d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afec13d8a86a135 server_cookie=1f6b8d051e41fca in_seq=0 out_seq=0 2024-09-10T07:48:43.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.755+0000 7f51617fa640 10 client.14958 ms_handle_connect on v2:172.21.15.102:6838/330469529 2024-09-10T07:48:43.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.755+0000 7f51617fa640 1 -- 172.21.15.73:0/2641456116 <== mds.0 v2:172.21.15.102:6838/330469529 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d72db63600 con 0x55d72dc0b160 2024-09-10T07:48:43.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.755+0000 7f51617fa640 10 client.14958 handle_command_reply: tid=0 2024-09-10T07:48:43.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.755+0000 7f5182098740 1 client.14958 shutdown 2024-09-10T07:48:43.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 -- 172.21.15.73:0/2641456116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbfabb0 msgr2=0x55d72dbf7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:43.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbfabb0 0x55d72dbf7cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5170009830 tx=0x7f517002f3a0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 -- 172.21.15.73:0/2641456116 shutdown_connections 2024-09-10T07:48:43.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55d72dc0b160 0x55d72dc0c5d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbfabb0 0x55d72dbf7cf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbf02f0 0x55d72dbf77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 --2- 172.21.15.73:0/2641456116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 0x55d72dbfa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 -- 172.21.15.73:0/2641456116 >> 172.21.15.73:0/2641456116 conn(0x55d72dbebf60 msgr2=0x55d72dbf1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:43.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f51617fa640 0 client.14958 ms_handle_reset on v2:172.21.15.102:6838/330469529 2024-09-10T07:48:43.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 -- 172.21.15.73:0/2641456116 shutdown_connections 2024-09-10T07:48:43.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 1 -- 172.21.15.73:0/2641456116 wait complete. 2024-09-10T07:48:43.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.756+0000 7f5182098740 20 client.14958 trim_cache size 0 max 16384 2024-09-10T07:48:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f5182098740 1 Processor -- start 2024-09-10T07:48:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f5182098740 1 -- start start 2024-09-10T07:48:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f5182098740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 0x55d72dc0b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f5182098740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbf02f0 0x55d72dc14ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f5182098740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbfabb0 0x55d72dbf4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f5182098740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d72dc0a910 con 0x55d72dbf02f0 2024-09-10T07:48:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f5182098740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d72dc0afe0 con 0x55d72dbef9d0 2024-09-10T07:48:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f5182098740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d72dc0b6b0 con 0x55d72dbfabb0 2024-09-10T07:48:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517d25a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbf02f0 0x55d72dc14ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517d25a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbf02f0 0x55d72dc14ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47204/0 (socket says 172.21.15.73:47204) 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517d25a640 1 -- 172.21.15.73:0/2013110753 learned_addr learned my addr 172.21.15.73:0/2013110753 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517da5b640 1 --2- 172.21.15.73:0/2013110753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 0x55d72dc0b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517d25a640 1 -- 172.21.15.73:0/2013110753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbfabb0 msgr2=0x55d72dbf4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517d25a640 1 --2- 172.21.15.73:0/2013110753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbfabb0 0x55d72dbf4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517d25a640 1 -- 172.21.15.73:0/2013110753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 msgr2=0x55d72dc0b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517d25a640 1 --2- 172.21.15.73:0/2013110753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 0x55d72dc0b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517d25a640 1 -- 172.21.15.73:0/2013110753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d72dbef800 con 0x55d72dbf02f0 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f517d25a640 1 --2- 172.21.15.73:0/2013110753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbf02f0 0x55d72dc14ca0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f516809aa50 tx=0x7f51680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1889d3801f123f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f51637fe640 1 -- 172.21.15.73:0/2013110753 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516801e040 con 0x55d72dbf02f0 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.774+0000 7f51637fe640 1 -- 172.21.15.73:0/2013110753 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f516809ad50 con 0x55d72dbf02f0 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f51637fe640 1 -- 172.21.15.73:0/2013110753 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51680973c0 con 0x55d72dbf02f0 2024-09-10T07:48:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 -- 172.21.15.73:0/2013110753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbf02f0 msgr2=0x55d72dc14ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 --2- 172.21.15.73:0/2013110753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbf02f0 0x55d72dc14ca0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f516809aa50 tx=0x7f51680046c0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 -- 172.21.15.73:0/2013110753 shutdown_connections 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 --2- 172.21.15.73:0/2013110753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbfabb0 0x55d72dbf4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 --2- 172.21.15.73:0/2013110753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbf02f0 0x55d72dc14ca0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 --2- 172.21.15.73:0/2013110753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbef9d0 0x55d72dc0b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 -- 172.21.15.73:0/2013110753 >> 172.21.15.73:0/2013110753 conn(0x55d72dbebf60 msgr2=0x55d72dbf9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 -- 172.21.15.73:0/2013110753 shutdown_connections 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 -- 172.21.15.73:0/2013110753 wait complete. 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.775+0000 7f5182098740 1 -- start start 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f5182098740 1 Processor -- start 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f5182098740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dc72110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f5182098740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbf02f0 0x55d72dc72650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f5182098740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbfabb0 0x55d72dbf4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f5182098740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d72dc0c450 con 0x55d72dbef9d0 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f5182098740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d72dc0bd80 con 0x55d72dbf02f0 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f5182098740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d72dc0cb20 con 0x55d72dbfabb0 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f5182098740 10 client.0 _ll_register_callbacks cb 0x7f517400b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517da5b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dc72110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517da5b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dc72110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47210/0 (socket says 172.21.15.73:47210) 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517da5b640 1 -- 172.21.15.73:0/3342292962 learned_addr learned my addr 172.21.15.73:0/3342292962 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517e25c640 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbfabb0 0x55d72dbf4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517d25a640 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbf02f0 0x55d72dc72650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517da5b640 1 -- 172.21.15.73:0/3342292962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbfabb0 msgr2=0x55d72dbf4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517da5b640 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbfabb0 0x55d72dbf4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517da5b640 1 -- 172.21.15.73:0/3342292962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbf02f0 msgr2=0x55d72dc72650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:48:43.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517da5b640 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbf02f0 0x55d72dc72650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.776+0000 7f517da5b640 1 -- 172.21.15.73:0/3342292962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d72dbf4f50 con 0x55d72dbef9d0 2024-09-10T07:48:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f517da5b640 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dc72110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55d72dc0ce00 tx=0x7f51740157f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557bbff88903059d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f51617fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-10T07:48:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f51617fa640 1 -- 172.21.15.73:0/3342292962 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5174015e00 con 0x55d72dbef9d0 2024-09-10T07:48:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f51617fa640 1 -- 172.21.15.73:0/3342292962 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f51740135c0 con 0x55d72dbef9d0 2024-09-10T07:48:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f5182098740 1 -- 172.21.15.73:0/3342292962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f516809ad50 con 0x55d72dbef9d0 2024-09-10T07:48:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f51617fa640 1 -- 172.21.15.73:0/3342292962 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f51740137c0 con 0x55d72dbef9d0 2024-09-10T07:48:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f5182098740 10 client.14964 fetch_fsmap learned FSMap version 19 2024-09-10T07:48:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f5182098740 1 -- 172.21.15.73:0/3342292962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d72dc79950 con 0x55d72dbef9d0 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f51617fa640 1 -- 172.21.15.73:0/3342292962 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f516809ad50 con 0x55d72dbef9d0 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f51617fa640 1 -- 172.21.15.73:0/3342292962 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f517402fb20 con 0x55d72dbef9d0 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f5182098740 10 client.14964 fetch_fsmap finished waiting for FSMap version 19 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f5182098740 10 client.14964 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f5182098740 20 client.14964 populate_metadata read hostname 'smithi073' 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f5182098740 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55d72dc7e590 0x55d72dc7d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f5182098740 4 client.14964 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.777+0000 7f5182098740 1 -- 172.21.15.73:0/3342292962 --> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] -- command(tid 0: {"prefix": "status"}) -- 0x55d72db5db10 con 0x55d72dc7e590 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f517d25a640 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55d72dc7e590 0x55d72dc7d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f517d25a640 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55d72dc7e590 0x55d72dc7d2a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f25ecf1c939faa server_cookie=3cd61aba2591eb1d in_seq=0 out_seq=0 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f51617fa640 10 client.14964 ms_handle_connect on v2:172.21.15.102:6838/330469529 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f51617fa640 1 -- 172.21.15.73:0/3342292962 <== mds.0 v2:172.21.15.102:6838/330469529 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d72db5db10 con 0x55d72dc7e590 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f51617fa640 10 client.14964 handle_command_reply: tid=0 2024-09-10T07:48:43.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 client.14964 shutdown 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 -- 172.21.15.73:0/3342292962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 msgr2=0x55d72dc72110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dc72110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55d72dc0ce00 tx=0x7f51740157f0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 -- 172.21.15.73:0/3342292962 shutdown_connections 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55d72dc7e590 0x55d72dc7d2a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d72dbfabb0 0x55d72dbf4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d72dbf02f0 0x55d72dc72650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 --2- 172.21.15.73:0/3342292962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d72dbef9d0 0x55d72dc72110 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f51617fa640 0 client.14964 ms_handle_reset on v2:172.21.15.102:6838/330469529 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 -- 172.21.15.73:0/3342292962 >> 172.21.15.73:0/3342292962 conn(0x55d72dbebf60 msgr2=0x55d72dbf70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 -- 172.21.15.73:0/3342292962 shutdown_connections 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.778+0000 7f5182098740 1 -- 172.21.15.73:0/3342292962 wait complete. 2024-09-10T07:48:43.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f5182098740 20 client.14964 trim_cache size 0 max 16384 2024-09-10T07:48:43.786 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T07:48:43.786 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "c025e280-6f47-11ef-bcea-c7b262605968", 2024-09-10T07:48:43.786 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-10T07:48:43.786 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24485, 2024-09-10T07:48:43.786 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-10T07:48:43.786 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-10T07:48:43.786 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-10T07:48:43.786 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 70.659457492000001, 2024-09-10T07:48:43.786 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 19, 2024-09-10T07:48:43.787 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 83, 2024-09-10T07:48:43.787 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 81, 2024-09-10T07:48:43.787 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 81.235790660999996 2024-09-10T07:48:43.787 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 -- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f51640a2c10 msgr2=0x7f51640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f51640a2c10 0x7f51640a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f517004c000 tx=0x7f517004a000 comp rx=0 tx=0).stop 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 -- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178102790 msgr2=0x7f5178198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178102790 0x7f5178198ad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f516800b4a0 tx=0x7f516800b960 comp rx=0 tx=0).stop 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 -- 172.21.15.73:0/4205398785 shutdown_connections 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f51640a2c10 0x7f51640a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5178106f10 0x7f517819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5178102790 0x7f5178198ad0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 --2- 172.21.15.73:0/4205398785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5178101de0 0x7f5178198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 -- 172.21.15.73:0/4205398785 >> 172.21.15.73:0/4205398785 conn(0x7f51780fd8c0 msgr2=0x7f51780fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 -- 172.21.15.73:0/4205398785 shutdown_connections 2024-09-10T07:48:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:43.779+0000 7f517fcbf640 1 -- 172.21.15.73:0/4205398785 wait complete. 2024-09-10T07:48:44.437 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T07:48:44.437 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T07:48:44.527 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T07:48:44.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T07:48:44.776 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.335+0000 7fe687e29640 1 -- 172.21.15.73:0/2842250610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 msgr2=0x7fe6801073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.335+0000 7fe687e29640 1 --2- 172.21.15.73:0/2842250610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 0x7fe6801073b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe674009900 tx=0x7fe67402a3f0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.336+0000 7fe687e29640 1 -- 172.21.15.73:0/2842250610 shutdown_connections 2024-09-10T07:48:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.336+0000 7fe687e29640 1 --2- 172.21.15.73:0/2842250610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6801078f0 0x7fe680109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.336+0000 7fe687e29640 1 --2- 172.21.15.73:0/2842250610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 0x7fe6801073b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.336+0000 7fe687e29640 1 --2- 172.21.15.73:0/2842250610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe680102690 0x7fe680104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.336+0000 7fe687e29640 1 -- 172.21.15.73:0/2842250610 >> 172.21.15.73:0/2842250610 conn(0x7fe6800fc290 msgr2=0x7fe6800fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.336+0000 7fe687e29640 1 -- 172.21.15.73:0/2842250610 shutdown_connections 2024-09-10T07:48:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.336+0000 7fe687e29640 1 -- 172.21.15.73:0/2842250610 wait complete. 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.336+0000 7fe687e29640 1 Processor -- start 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.336+0000 7fe687e29640 1 -- start start 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe687e29640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe680102690 0x7fe680197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe687e29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 0x7fe680198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe687e29640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6801078f0 0x7fe68019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe687e29640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe68010d890 con 0x7fe680104fc0 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe687e29640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe68010d710 con 0x7fe680102690 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe687e29640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe68010da10 con 0x7fe6801078f0 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6853c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 0x7fe680198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6853c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 0x7fe680198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47218/0 (socket says 172.21.15.73:47218) 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6853c4640 1 -- 172.21.15.73:0/418932015 learned_addr learned my addr 172.21.15.73:0/418932015 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6863c6640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6801078f0 0x7fe68019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe685bc5640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe680102690 0x7fe680197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6853c4640 1 -- 172.21.15.73:0/418932015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6801078f0 msgr2=0x7fe68019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6853c4640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6801078f0 0x7fe68019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6853c4640 1 -- 172.21.15.73:0/418932015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe680102690 msgr2=0x7fe680197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6853c4640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe680102690 0x7fe680197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6853c4640 1 -- 172.21.15.73:0/418932015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68019fb70 con 0x7fe680104fc0 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe6853c4640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 0x7fe680198480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe674031610 tx=0x7fe6740043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe67effd640 1 -- 172.21.15.73:0/418932015 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67403f030 con 0x7fe680104fc0 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe67effd640 1 -- 172.21.15.73:0/418932015 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe674003ce0 con 0x7fe680104fc0 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68019fe00 con 0x7fe680104fc0 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe67effd640 1 -- 172.21.15.73:0/418932015 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674035070 con 0x7fe680104fc0 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.337+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6801a0250 con 0x7fe680104fc0 2024-09-10T07:48:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.338+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6800fdd80 con 0x7fe680104fc0 2024-09-10T07:48:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.339+0000 7fe67effd640 1 -- 172.21.15.73:0/418932015 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe674042030 con 0x7fe680104fc0 2024-09-10T07:48:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.340+0000 7fe67effd640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe6680a2c40 0x7fe6680a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.340+0000 7fe685bc5640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe6680a2c40 0x7fe6680a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.340+0000 7fe67effd640 1 -- 172.21.15.73:0/418932015 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe6740ef430 con 0x7fe680104fc0 2024-09-10T07:48:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.340+0000 7fe685bc5640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe6680a2c40 0x7fe6680a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe670005fd0 tx=0x7fe670009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.344+0000 7fe67effd640 1 -- 172.21.15.73:0/418932015 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6740bc210 con 0x7fe680104fc0 2024-09-10T07:48:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.530+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fe680062630 con 0x7fe6680a2c40 2024-09-10T07:48:45.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.531+0000 7fe67effd640 1 -- 172.21.15.73:0/418932015 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fe680062630 con 0x7fe6680a2c40 2024-09-10T07:48:45.531 INFO:teuthology.orchestra.run.smithi073.stdout:Backend: cephadm 2024-09-10T07:48:45.531 INFO:teuthology.orchestra.run.smithi073.stdout:Available: Yes 2024-09-10T07:48:45.531 INFO:teuthology.orchestra.run.smithi073.stdout:Paused: No 2024-09-10T07:48:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe6680a2c40 msgr2=0x7fe6680a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe6680a2c40 0x7fe6680a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe670005fd0 tx=0x7fe670009870 comp rx=0 tx=0).stop 2024-09-10T07:48:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 msgr2=0x7fe680198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 0x7fe680198480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe674031610 tx=0x7fe6740043b0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 shutdown_connections 2024-09-10T07:48:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fe6680a2c40 0x7fe6680a5100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6801078f0 0x7fe68019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe680104fc0 0x7fe680198480 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 --2- 172.21.15.73:0/418932015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe680102690 0x7fe680197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 >> 172.21.15.73:0/418932015 conn(0x7fe6800fc290 msgr2=0x7fe680103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 shutdown_connections 2024-09-10T07:48:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:45.534+0000 7fe687e29640 1 -- 172.21.15.73:0/418932015 wait complete. 2024-09-10T07:48:45.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:45 smithi073 ceph-mon[30850]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:45.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-10T07:48:45.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:45 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-10T07:48:46.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:45 smithi102 ceph-mon[35514]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:46.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-10T07:48:46.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:45 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-10T07:48:46.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:45 smithi159 ceph-mon[35522]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:46.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-10T07:48:46.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:45 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-10T07:48:46.213 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T07:48:46.469 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:46.845 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:46 smithi073 ceph-mon[30850]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:46.846 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-10T07:48:46.846 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:46 smithi073 ceph-mon[30850]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-10T07:48:46.846 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:46 smithi073 ceph-mon[30850]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T07:48:46.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.926+0000 7f606cbf0640 1 -- 172.21.15.73:0/3570184214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 msgr2=0x7f6068100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:46.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.926+0000 7f606cbf0640 1 --2- 172.21.15.73:0/3570184214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 0x7f6068100f10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6050009900 tx=0x7f605002a410 comp rx=0 tx=0).stop 2024-09-10T07:48:46.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.926+0000 7f606cbf0640 1 -- 172.21.15.73:0/3570184214 shutdown_connections 2024-09-10T07:48:46.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.926+0000 7f606cbf0640 1 --2- 172.21.15.73:0/3570184214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60681026d0 0x7f6068108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:46.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.926+0000 7f606cbf0640 1 --2- 172.21.15.73:0/3570184214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6068101d10 0x7f6068102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:46.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.926+0000 7f606cbf0640 1 --2- 172.21.15.73:0/3570184214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 0x7f6068100f10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:46.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.926+0000 7f606cbf0640 1 -- 172.21.15.73:0/3570184214 >> 172.21.15.73:0/3570184214 conn(0x7f60680fc2a0 msgr2=0x7f60680fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:46.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.926+0000 7f606cbf0640 1 -- 172.21.15.73:0/3570184214 shutdown_connections 2024-09-10T07:48:46.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.926+0000 7f606cbf0640 1 -- 172.21.15.73:0/3570184214 wait complete. 2024-09-10T07:48:46.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606cbf0640 1 Processor -- start 2024-09-10T07:48:46.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606cbf0640 1 -- start start 2024-09-10T07:48:46.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606cbf0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 0x7f6068196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:46.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606cbf0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6068101d10 0x7f60681974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:46.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606cbf0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60681026d0 0x7f606819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606cbf0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f606810c870 con 0x7f6068100b10 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606cbf0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f606810c6f0 con 0x7f6068101d10 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606cbf0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f606810c9f0 con 0x7f60681026d0 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 0x7f6068196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 0x7f6068196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47248/0 (socket says 172.21.15.73:47248) 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.927+0000 7f606659c640 1 -- 172.21.15.73:0/580355062 learned_addr learned my addr 172.21.15.73:0/580355062 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f606659c640 1 -- 172.21.15.73:0/580355062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60681026d0 msgr2=0x7f606819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f6066d9d640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60681026d0 0x7f606819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f606659c640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60681026d0 0x7f606819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f606659c640 1 -- 172.21.15.73:0/580355062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6068101d10 msgr2=0x7f60681974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f6065d9b640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6068101d10 0x7f60681974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f606659c640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6068101d10 0x7f60681974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:46.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f606659c640 1 -- 172.21.15.73:0/580355062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606806a810 con 0x7f6068100b10 2024-09-10T07:48:46.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f6066d9d640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60681026d0 0x7f606819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:46.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f606659c640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 0x7f6068196f90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6050031610 tx=0x7f60500043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:46.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f605f7fe640 1 -- 172.21.15.73:0/580355062 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605003f030 con 0x7f6068100b10 2024-09-10T07:48:46.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606806aaa0 con 0x7f6068100b10 2024-09-10T07:48:46.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f605f7fe640 1 -- 172.21.15.73:0/580355062 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6050003ce0 con 0x7f6068100b10 2024-09-10T07:48:46.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f605f7fe640 1 -- 172.21.15.73:0/580355062 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6050035070 con 0x7f6068100b10 2024-09-10T07:48:46.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.928+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f606806b050 con 0x7f6068100b10 2024-09-10T07:48:46.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.929+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6068108050 con 0x7f6068100b10 2024-09-10T07:48:46.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.930+0000 7f605f7fe640 1 -- 172.21.15.73:0/580355062 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6050042030 con 0x7f6068100b10 2024-09-10T07:48:46.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.931+0000 7f605f7fe640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f60540a2c40 0x7f60540a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:46.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.931+0000 7f605f7fe640 1 -- 172.21.15.73:0/580355062 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f60500efbd0 con 0x7f6068100b10 2024-09-10T07:48:46.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.931+0000 7f6065d9b640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f60540a2c40 0x7f60540a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:46.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.932+0000 7f6065d9b640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f60540a2c40 0x7f60540a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f60681984b0 tx=0x7f6058008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:46.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:46.934+0000 7f605f7fe640 1 -- 172.21.15.73:0/580355062 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60500bc970 con 0x7f6068100b10 2024-09-10T07:48:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.110+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6068062630 con 0x7f60540a2c40 2024-09-10T07:48:47.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.122+0000 7f605f7fe640 1 -- 172.21.15.73:0/580355062 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f6068062630 con 0x7f60540a2c40 2024-09-10T07:48:47.122 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T07:48:47.122 INFO:teuthology.orchestra.run.smithi073.stdout:mds.a smithi073 running (87s) 14s ago 87s 13.3M - 19.1.1-305-g1cf819b7 41d671128357 5e538020fa47 2024-09-10T07:48:47.122 INFO:teuthology.orchestra.run.smithi073.stdout:mds.b smithi102 running (84s) 18s ago 84s 30.4M - 19.1.1-305-g1cf819b7 41d671128357 02686c4ab490 2024-09-10T07:48:47.122 INFO:teuthology.orchestra.run.smithi073.stdout:mds.c smithi159 running (99s) 18s ago 98s 15.8M - 19.1.1-305-g1cf819b7 41d671128357 6c194b5f1bea 2024-09-10T07:48:47.122 INFO:teuthology.orchestra.run.smithi073.stdout:mds.d smithi073 running (106s) 14s ago 106s 14.3M - 19.1.1-305-g1cf819b7 41d671128357 ec0bbc1f0b4c 2024-09-10T07:48:47.122 INFO:teuthology.orchestra.run.smithi073.stdout:mds.e smithi102 running (103s) 18s ago 103s 15.8M - 19.1.1-305-g1cf819b7 41d671128357 805291d919c2 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mds.f smithi159 running (101s) 18s ago 101s 16.7M - 19.1.1-305-g1cf819b7 41d671128357 4eb1658c4f8e 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mds.g smithi073 running (91s) 14s ago 90s 14.2M - 19.1.1-305-g1cf819b7 41d671128357 759da43ef5ec 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mds.h smithi102 running (96s) 18s ago 96s 20.5M - 19.1.1-305-g1cf819b7 41d671128357 0b6b6cbd4ef3 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mds.i smithi159 running (93s) 18s ago 93s 13.2M - 19.1.1-305-g1cf819b7 41d671128357 812aef7b875d 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mds.j smithi073 running (110s) 14s ago 109s 14.5M - 19.1.1-305-g1cf819b7 41d671128357 4e98fc235b7f 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mds.k smithi102 running (113s) 18s ago 112s 14.4M - 19.1.1-305-g1cf819b7 41d671128357 2239ec040b22 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mds.l smithi159 running (115s) 18s ago 115s 14.4M - 19.1.1-305-g1cf819b7 41d671128357 1630eb3d517a 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.x smithi073 *:9283,8765 running (8m) 14s ago 8m 508M - 19.1.1-305-g1cf819b7 41d671128357 196638ff1891 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.y smithi102 *:8443,8765 running (7m) 18s ago 7m 444M - 19.1.1-305-g1cf819b7 41d671128357 42f4375eb869 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.z smithi159 *:8443,8765 running (7m) 18s ago 7m 442M - 19.1.1-305-g1cf819b7 41d671128357 5f1653ae19b5 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a smithi073 running (8m) 14s ago 8m 51.5M 2048M 19.1.1-305-g1cf819b7 41d671128357 ef87ed974fd0 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b smithi102 running (7m) 18s ago 7m 40.3M 2048M 19.1.1-305-g1cf819b7 41d671128357 b718932ee724 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c smithi159 running (7m) 18s ago 7m 43.7M 2048M 19.1.1-305-g1cf819b7 41d671128357 d3abba75b6d8 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (6m) 14s ago 6m 47.6M 4272M 19.1.1-305-g1cf819b7 41d671128357 b69e0fb466f1 2024-09-10T07:48:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi102 running (6m) 18s ago 6m 48.9M 4272M 19.1.1-305-g1cf819b7 41d671128357 6fc2544df2fe 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi159 running (5m) 18s ago 5m 49.3M 4272M 19.1.1-305-g1cf819b7 41d671128357 ddbdd9a766ad 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi073 running (5m) 14s ago 5m 45.4M 4272M 19.1.1-305-g1cf819b7 41d671128357 194a011cca7e 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi102 running (5m) 18s ago 5m 51.0M 4272M 19.1.1-305-g1cf819b7 41d671128357 7f9a0494985f 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi159 running (4m) 18s ago 4m 47.1M 4272M 19.1.1-305-g1cf819b7 41d671128357 00b00926d70b 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.6 smithi073 running (4m) 14s ago 4m 49.1M 4272M 19.1.1-305-g1cf819b7 41d671128357 134ceaa189e8 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.7 smithi102 running (3m) 18s ago 3m 55.6M 4272M 19.1.1-305-g1cf819b7 41d671128357 2cb8d5e5514e 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.8 smithi159 running (3m) 18s ago 3m 45.4M 4272M 19.1.1-305-g1cf819b7 41d671128357 a8a3d0027c92 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.9 smithi073 running (3m) 14s ago 3m 43.8M 4272M 19.1.1-305-g1cf819b7 41d671128357 acde939d94e3 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.10 smithi102 running (2m) 18s ago 2m 49.2M 4272M 19.1.1-305-g1cf819b7 41d671128357 671ffeb1a98a 2024-09-10T07:48:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.11 smithi159 running (2m) 18s ago 2m 50.0M 4272M 19.1.1-305-g1cf819b7 41d671128357 b6edacdff93a 2024-09-10T07:48:47.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f60540a2c40 msgr2=0x7f60540a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:47.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f60540a2c40 0x7f60540a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f60681984b0 tx=0x7f6058008040 comp rx=0 tx=0).stop 2024-09-10T07:48:47.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 msgr2=0x7f6068196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:47.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 0x7f6068196f90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6050031610 tx=0x7f60500043b0 comp rx=0 tx=0).stop 2024-09-10T07:48:47.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 shutdown_connections 2024-09-10T07:48:47.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f60540a2c40 0x7f60540a5100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:47.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60681026d0 0x7f606819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:47.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6068101d10 0x7f60681974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:47.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 --2- 172.21.15.73:0/580355062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6068100b10 0x7f6068196f90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:47.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 >> 172.21.15.73:0/580355062 conn(0x7f60680fc2a0 msgr2=0x7f6068105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:47.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 shutdown_connections 2024-09-10T07:48:47.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:47.125+0000 7f606cbf0640 1 -- 172.21.15.73:0/580355062 wait complete. 2024-09-10T07:48:47.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:46 smithi102 ceph-mon[35514]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:47.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-10T07:48:47.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:46 smithi102 ceph-mon[35514]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-10T07:48:47.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:46 smithi102 ceph-mon[35514]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T07:48:47.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:46 smithi159 ceph-mon[35522]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:47.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-10T07:48:47.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:46 smithi159 ceph-mon[35522]: from='mgr.14150 172.21.15.73:0/588742217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-10T07:48:47.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:46 smithi159 ceph-mon[35522]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T07:48:47.825 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:47 smithi073 ceph-mon[30850]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:48:47.825 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:47 smithi073 ceph-mon[30850]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T07:48:47.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T07:48:48.096 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:47 smithi102 ceph-mon[35514]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:48:48.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:47 smithi102 ceph-mon[35514]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T07:48:48.156 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:47 smithi159 ceph-mon[35522]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:48:48.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:47 smithi159 ceph-mon[35522]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T07:48:48.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.609+0000 7fb278ccd640 1 -- 172.21.15.73:0/2328670729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2741037c0 msgr2=0x7fb27410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:48.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.609+0000 7fb278ccd640 1 --2- 172.21.15.73:0/2328670729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2741037c0 0x7fb27410a050 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ca0 tx=0x7fb26c02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.609+0000 7fb278ccd640 1 -- 172.21.15.73:0/2328670729 shutdown_connections 2024-09-10T07:48:48.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.609+0000 7fb278ccd640 1 --2- 172.21.15.73:0/2328670729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2741037c0 0x7fb27410a050 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.609+0000 7fb278ccd640 1 --2- 172.21.15.73:0/2328670729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb274102e00 0x7fb274103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.609+0000 7fb278ccd640 1 --2- 172.21.15.73:0/2328670729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb274101c00 0x7fb274102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.609+0000 7fb278ccd640 1 -- 172.21.15.73:0/2328670729 >> 172.21.15.73:0/2328670729 conn(0x7fb2740fd390 msgr2=0x7fb2740ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.609+0000 7fb278ccd640 1 -- 172.21.15.73:0/2328670729 shutdown_connections 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.609+0000 7fb278ccd640 1 -- 172.21.15.73:0/2328670729 wait complete. 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb278ccd640 1 Processor -- start 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb278ccd640 1 -- start start 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb278ccd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb274101c00 0x7fb274197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb278ccd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb274102e00 0x7fb274198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb278ccd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2741037c0 0x7fb27419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb278ccd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb27410d8e0 con 0x7fb274101c00 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb278ccd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb27410d760 con 0x7fb2741037c0 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb278ccd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb27410da60 con 0x7fb274102e00 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb27259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb274101c00 0x7fb274197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb27259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb274101c00 0x7fb274197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47262/0 (socket says 172.21.15.73:47262) 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb27259c640 1 -- 172.21.15.73:0/296584841 learned_addr learned my addr 172.21.15.73:0/296584841 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:48.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb271d9b640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb274102e00 0x7fb274198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.610+0000 7fb272d9d640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2741037c0 0x7fb27419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb27259c640 1 -- 172.21.15.73:0/296584841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb274102e00 msgr2=0x7fb274198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb27259c640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb274102e00 0x7fb274198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb27259c640 1 -- 172.21.15.73:0/296584841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2741037c0 msgr2=0x7fb27419f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb27259c640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2741037c0 0x7fb27419f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb27259c640 1 -- 172.21.15.73:0/296584841 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27419fb00 con 0x7fb274101c00 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb27259c640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb274101c00 0x7fb274197ed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb26400d770 tx=0x7fb26400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb2637fe640 1 -- 172.21.15.73:0/296584841 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264017070 con 0x7fb274101c00 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27419fdf0 con 0x7fb274101c00 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb2637fe640 1 -- 172.21.15.73:0/296584841 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb264009d00 con 0x7fb274101c00 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb2637fe640 1 -- 172.21.15.73:0/296584841 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264003d30 con 0x7fb274101c00 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.611+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2741a02c0 con 0x7fb274101c00 2024-09-10T07:48:48.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.612+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb274108f50 con 0x7fb274101c00 2024-09-10T07:48:48.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.614+0000 7fb2637fe640 1 -- 172.21.15.73:0/296584841 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb264009820 con 0x7fb274101c00 2024-09-10T07:48:48.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.614+0000 7fb2637fe640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb25c0a2c40 0x7fb25c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:48.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.615+0000 7fb271d9b640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb25c0a2c40 0x7fb25c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:48.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.615+0000 7fb2637fe640 1 -- 172.21.15.73:0/296584841 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7fb2640ceec0 con 0x7fb274101c00 2024-09-10T07:48:48.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.615+0000 7fb271d9b640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb25c0a2c40 0x7fb25c0a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2741993f0 tx=0x7fb268009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:48.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.618+0000 7fb2637fe640 1 -- 172.21.15.73:0/296584841 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb26409bc60 con 0x7fb274101c00 2024-09-10T07:48:48.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.793+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fb274062630 con 0x7fb25c0a2c40 2024-09-10T07:48:48.793 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:48 smithi073 ceph-mon[30850]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.799+0000 7fb2637fe640 1 -- 172.21.15.73:0/296584841 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+985 (secure 0 0 0) 0x7fb274062630 con 0x7fb25c0a2c40 2024-09-10T07:48:48.798 INFO:teuthology.orchestra.run.smithi073.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T07:48:48.798 INFO:teuthology.orchestra.run.smithi073.stdout:mds.all 12/12 20s ago 119s smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-09-10T07:48:48.798 INFO:teuthology.orchestra.run.smithi073.stdout:mgr 3/3 20s ago 7m smithi073=x;smithi102=y;smithi159=z;count:3 2024-09-10T07:48:48.799 INFO:teuthology.orchestra.run.smithi073.stdout:mon 3/3 20s ago 7m smithi073:172.21.15.73=a;smithi102:172.21.15.102=b;smithi159:172.21.15.159=c;count:3 2024-09-10T07:48:48.799 INFO:teuthology.orchestra.run.smithi073.stdout:osd 12 20s ago - 2024-09-10T07:48:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb25c0a2c40 msgr2=0x7fb25c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb25c0a2c40 0x7fb25c0a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2741993f0 tx=0x7fb268009110 comp rx=0 tx=0).stop 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb274101c00 msgr2=0x7fb274197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb274101c00 0x7fb274197ed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb26400d770 tx=0x7fb26400db70 comp rx=0 tx=0).stop 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 shutdown_connections 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fb25c0a2c40 0x7fb25c0a5100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2741037c0 0x7fb27419f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb274102e00 0x7fb274198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 --2- 172.21.15.73:0/296584841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb274101c00 0x7fb274197ed0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 >> 172.21.15.73:0/296584841 conn(0x7fb2740fd390 msgr2=0x7fb274106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 shutdown_connections 2024-09-10T07:48:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:48.801+0000 7fb278ccd640 1 -- 172.21.15.73:0/296584841 wait complete. 2024-09-10T07:48:49.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:48 smithi102 ceph-mon[35514]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:49.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:48 smithi159 ceph-mon[35522]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:49.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T07:48:49.771 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:49.892 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:49 smithi073 ceph-mon[30850]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:49.892 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:49 smithi073 ceph-mon[30850]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:50.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:49 smithi102 ceph-mon[35514]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:50.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:49 smithi102 ceph-mon[35514]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:50.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:49 smithi159 ceph-mon[35522]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:50.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:49 smithi159 ceph-mon[35522]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:50.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.250+0000 7fbd9109a640 1 -- 172.21.15.73:0/3186142656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c102e00 msgr2=0x7fbd8c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:50.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.250+0000 7fbd9109a640 1 --2- 172.21.15.73:0/3186142656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c102e00 0x7fbd8c103280 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009900 tx=0x7fbd8002a410 comp rx=0 tx=0).stop 2024-09-10T07:48:50.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.250+0000 7fbd9109a640 1 -- 172.21.15.73:0/3186142656 shutdown_connections 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.250+0000 7fbd9109a640 1 --2- 172.21.15.73:0/3186142656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd8c1037c0 0x7fbd8c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.250+0000 7fbd9109a640 1 --2- 172.21.15.73:0/3186142656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c102e00 0x7fbd8c103280 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.250+0000 7fbd9109a640 1 --2- 172.21.15.73:0/3186142656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c101c00 0x7fbd8c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.250+0000 7fbd9109a640 1 -- 172.21.15.73:0/3186142656 >> 172.21.15.73:0/3186142656 conn(0x7fbd8c0fd390 msgr2=0x7fbd8c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.250+0000 7fbd9109a640 1 -- 172.21.15.73:0/3186142656 shutdown_connections 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.250+0000 7fbd9109a640 1 -- 172.21.15.73:0/3186142656 wait complete. 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd9109a640 1 Processor -- start 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd9109a640 1 -- start start 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd9109a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd8c101c00 0x7fbd8c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd9109a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c102e00 0x7fbd8c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd9109a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c1037c0 0x7fbd8c19f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd9109a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c10d8e0 con 0x7fbd8c1037c0 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd9109a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c10d760 con 0x7fbd8c101c00 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd9109a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c10da60 con 0x7fbd8c102e00 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd8b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c1037c0 0x7fbd8c19f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd8b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c1037c0 0x7fbd8c19f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55574/0 (socket says 172.21.15.73:55574) 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.251+0000 7fbd8b59e640 1 -- 172.21.15.73:0/2413337035 learned_addr learned my addr 172.21.15.73:0/2413337035 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd8ad9d640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd8c101c00 0x7fbd8c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd8a59c640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c102e00 0x7fbd8c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd8b59e640 1 -- 172.21.15.73:0/2413337035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c102e00 msgr2=0x7fbd8c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd8b59e640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c102e00 0x7fbd8c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd8b59e640 1 -- 172.21.15.73:0/2413337035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd8c101c00 msgr2=0x7fbd8c197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd8b59e640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd8c101c00 0x7fbd8c197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd8b59e640 1 -- 172.21.15.73:0/2413337035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c19fba0 con 0x7fbd8c1037c0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd8ad9d640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd8c101c00 0x7fbd8c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd8b59e640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c1037c0 0x7fbd8c19f530 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400b970 tx=0x7fbd8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd73fff640 1 -- 172.21.15.73:0/2413337035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84019070 con 0x7fbd8c1037c0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd73fff640 1 -- 172.21.15.73:0/2413337035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd8400cb40 con 0x7fbd8c1037c0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c19fe90 con 0x7fbd8c1037c0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd73fff640 1 -- 172.21.15.73:0/2413337035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84007650 con 0x7fbd8c1037c0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.252+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c1a0370 con 0x7fbd8c1037c0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.253+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd8c108f50 con 0x7fbd8c1037c0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.254+0000 7fbd73fff640 1 -- 172.21.15.73:0/2413337035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbd8401c070 con 0x7fbd8c1037c0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.255+0000 7fbd73fff640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbd740a2c40 0x7fbd740a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.255+0000 7fbd8ad9d640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbd740a2c40 0x7fbd740a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.255+0000 7fbd73fff640 1 -- 172.21.15.73:0/2413337035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7fbd840ce760 con 0x7fbd8c1037c0 2024-09-10T07:48:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.255+0000 7fbd8ad9d640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbd740a2c40 0x7fbd740a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c102c60 tx=0x7fbd7c005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.259+0000 7fbd73fff640 1 -- 172.21.15.73:0/2413337035 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd8409b610 con 0x7fbd8c1037c0 2024-09-10T07:48:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.430+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fbd8c062630 con 0x7fbd740a2c40 2024-09-10T07:48:50.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.431+0000 7fbd73fff640 1 -- 172.21.15.73:0/2413337035 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fbd8c062630 con 0x7fbd740a2c40 2024-09-10T07:48:50.431 INFO:teuthology.orchestra.run.smithi073.stdout:HOST ADDR LABELS STATUS 2024-09-10T07:48:50.431 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 172.21.15.73 2024-09-10T07:48:50.432 INFO:teuthology.orchestra.run.smithi073.stdout:smithi102 172.21.15.102 2024-09-10T07:48:50.432 INFO:teuthology.orchestra.run.smithi073.stdout:smithi159 172.21.15.159 2024-09-10T07:48:50.432 INFO:teuthology.orchestra.run.smithi073.stdout:3 hosts in cluster 2024-09-10T07:48:50.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.433+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbd740a2c40 msgr2=0x7fbd740a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:50.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.433+0000 7fbd9109a640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbd740a2c40 0x7fbd740a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c102c60 tx=0x7fbd7c005d30 comp rx=0 tx=0).stop 2024-09-10T07:48:50.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.433+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c1037c0 msgr2=0x7fbd8c19f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:50.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.433+0000 7fbd9109a640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c1037c0 0x7fbd8c19f530 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400b970 tx=0x7fbd8400be30 comp rx=0 tx=0).stop 2024-09-10T07:48:50.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.433+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 shutdown_connections 2024-09-10T07:48:50.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.433+0000 7fbd9109a640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbd740a2c40 0x7fbd740a5100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:50.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.433+0000 7fbd9109a640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd8c1037c0 0x7fbd8c19f530 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:50.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.433+0000 7fbd9109a640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c102e00 0x7fbd8c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:50.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.433+0000 7fbd9109a640 1 --2- 172.21.15.73:0/2413337035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd8c101c00 0x7fbd8c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:50.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.434+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 >> 172.21.15.73:0/2413337035 conn(0x7fbd8c0fd390 msgr2=0x7fbd8c106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:50.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.434+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 shutdown_connections 2024-09-10T07:48:50.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:50.434+0000 7fbd9109a640 1 -- 172.21.15.73:0/2413337035 wait complete. 2024-09-10T07:48:51.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T07:48:51.312 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:51.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.743+0000 7f0481784640 1 -- 172.21.15.73:0/2830335703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c104f90 msgr2=0x7f047c107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:51.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.743+0000 7f0481784640 1 --2- 172.21.15.73:0/2830335703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c104f90 0x7f047c107380 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0464009900 tx=0x7f046402a410 comp rx=0 tx=0).stop 2024-09-10T07:48:51.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.743+0000 7f0481784640 1 -- 172.21.15.73:0/2830335703 shutdown_connections 2024-09-10T07:48:51.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.743+0000 7f0481784640 1 --2- 172.21.15.73:0/2830335703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f047c1078c0 0x7f047c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.743+0000 7f0481784640 1 --2- 172.21.15.73:0/2830335703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c104f90 0x7f047c107380 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.743+0000 7f0481784640 1 --2- 172.21.15.73:0/2830335703 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f047c102660 0x7f047c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.743+0000 7f0481784640 1 -- 172.21.15.73:0/2830335703 >> 172.21.15.73:0/2830335703 conn(0x7f047c0fc280 msgr2=0x7f047c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.743+0000 7f0481784640 1 -- 172.21.15.73:0/2830335703 shutdown_connections 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.743+0000 7f0481784640 1 -- 172.21.15.73:0/2830335703 wait complete. 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f0481784640 1 Processor -- start 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f0481784640 1 -- start start 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f0481784640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c102660 0x7f047c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f0481784640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f047c104f90 0x7f047c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f0481784640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f047c1078c0 0x7f047c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f0481784640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f047c10d8b0 con 0x7f047c102660 2024-09-10T07:48:51.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f0481784640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f047c10d730 con 0x7f047c104f90 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f0481784640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f047c10da30 con 0x7f047c1078c0 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f047affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c102660 0x7f047c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f047affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c102660 0x7f047c197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55596/0 (socket says 172.21.15.73:55596) 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f047affd640 1 -- 172.21.15.73:0/3384220049 learned_addr learned my addr 172.21.15.73:0/3384220049 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f047b7fe640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f047c1078c0 0x7f047c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f047a7fc640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f047c104f90 0x7f047c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.744+0000 7f047affd640 1 -- 172.21.15.73:0/3384220049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f047c1078c0 msgr2=0x7f047c19f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f047affd640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f047c1078c0 0x7f047c19f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f047affd640 1 -- 172.21.15.73:0/3384220049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f047c104f90 msgr2=0x7f047c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f047affd640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f047c104f90 0x7f047c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f047affd640 1 -- 172.21.15.73:0/3384220049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c19fbd0 con 0x7f047c102660 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f047b7fe640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f047c1078c0 0x7f047c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f047a7fc640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f047c104f90 0x7f047c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:51.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f047affd640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c102660 0x7f047c197fa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f046c00eab0 tx=0x7f046c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f0473fff640 1 -- 172.21.15.73:0/3384220049 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c00ce40 con 0x7f047c102660 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047c19fec0 con 0x7f047c102660 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f0473fff640 1 -- 172.21.15.73:0/3384220049 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f046c011950 con 0x7f047c102660 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f0473fff640 1 -- 172.21.15.73:0/3384220049 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c010ae0 con 0x7f047c102660 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.745+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047c1a03a0 con 0x7f047c102660 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.746+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047c0fdd70 con 0x7f047c102660 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.747+0000 7f0473fff640 1 -- 172.21.15.73:0/3384220049 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f046c011b00 con 0x7f047c102660 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.748+0000 7f0473fff640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04680a2c40 0x7f04680a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.748+0000 7f047a7fc640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04680a2c40 0x7f04680a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.748+0000 7f0473fff640 1 -- 172.21.15.73:0/3384220049 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f046c0cf9c0 con 0x7f047c102660 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.748+0000 7f047a7fc640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04680a2c40 0x7f04680a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0464006010 tx=0x7f0464032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.752+0000 7f0473fff640 1 -- 172.21.15.73:0/3384220049 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f046c016030 con 0x7f047c102660 2024-09-10T07:48:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.925+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 --> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f047c062630 con 0x7f04680a2c40 2024-09-10T07:48:51.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.926+0000 7f0473fff640 1 -- 172.21.15.73:0/3384220049 <== mgr.14150 v2:172.21.15.73:6800/662943870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f047c062630 con 0x7f04680a2c40 2024-09-10T07:48:51.926 INFO:teuthology.orchestra.run.smithi073.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T07:48:51.926 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040115400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T07:48:51.926 INFO:teuthology.orchestra.run.smithi073.stdout:smithi102 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T07:48:51.926 INFO:teuthology.orchestra.run.smithi073.stdout:smithi159 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GH400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T07:48:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04680a2c40 msgr2=0x7f04680a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04680a2c40 0x7f04680a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0464006010 tx=0x7f0464032dd0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c102660 msgr2=0x7f047c197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c102660 0x7f047c197fa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f046c00eab0 tx=0x7f046c00ef70 comp rx=0 tx=0).stop 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 shutdown_connections 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f04680a2c40 0x7f04680a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f047c1078c0 0x7f047c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f047c104f90 0x7f047c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 --2- 172.21.15.73:0/3384220049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f047c102660 0x7f047c197fa0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 >> 172.21.15.73:0/3384220049 conn(0x7f047c0fc280 msgr2=0x7f047c102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 shutdown_connections 2024-09-10T07:48:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:51.928+0000 7f0481784640 1 -- 172.21.15.73:0/3384220049 wait complete. 2024-09-10T07:48:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:51 smithi102 ceph-mon[35514]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:52.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:51 smithi102 ceph-mon[35514]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:51 smithi159 ceph-mon[35522]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:52.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:51 smithi159 ceph-mon[35522]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:52.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:51 smithi073 ceph-mon[30850]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:52.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:51 smithi073 ceph-mon[30850]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:48:52.652 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T07:48:52.663 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T07:48:52.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T07:48:52.910 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:53.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 -- 172.21.15.73:0/3417582967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e41026d0 msgr2=0x7f69e4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:53.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 --2- 172.21.15.73:0/3417582967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e41026d0 0x7f69e4108f60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009ca0 tx=0x7f69dc02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 -- 172.21.15.73:0/3417582967 shutdown_connections 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 --2- 172.21.15.73:0/3417582967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e41026d0 0x7f69e4108f60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 --2- 172.21.15.73:0/3417582967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69e4101d10 0x7f69e4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 --2- 172.21.15.73:0/3417582967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e4100b10 0x7f69e4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 -- 172.21.15.73:0/3417582967 >> 172.21.15.73:0/3417582967 conn(0x7f69e40fc2a0 msgr2=0x7f69e40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 -- 172.21.15.73:0/3417582967 shutdown_connections 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 -- 172.21.15.73:0/3417582967 wait complete. 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 Processor -- start 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.341+0000 7f69ea358640 1 -- start start 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69ea358640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e4100b10 0x7f69e4197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69ea358640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e4101d10 0x7f69e4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69ea358640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69e41026d0 0x7f69e419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69ea358640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f69e410c810 con 0x7f69e4101d10 2024-09-10T07:48:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69ea358640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f69e410c690 con 0x7f69e41026d0 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69ea358640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f69e410c990 con 0x7f69e4100b10 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e4101d10 0x7f69e4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e4101d10 0x7f69e4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55602/0 (socket says 172.21.15.73:55602) 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e37fe640 1 -- 172.21.15.73:0/1281261909 learned_addr learned my addr 172.21.15.73:0/1281261909 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e3fff640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e4100b10 0x7f69e4197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e88f5640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69e41026d0 0x7f69e419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e37fe640 1 -- 172.21.15.73:0/1281261909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e4100b10 msgr2=0x7f69e4197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e37fe640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e4100b10 0x7f69e4197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e37fe640 1 -- 172.21.15.73:0/1281261909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69e41026d0 msgr2=0x7f69e419f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e37fe640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69e41026d0 0x7f69e419f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e37fe640 1 -- 172.21.15.73:0/1281261909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e419fb80 con 0x7f69e4101d10 2024-09-10T07:48:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e88f5640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69e41026d0 0x7f69e419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:53.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.342+0000 7f69e37fe640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e4101d10 0x7f69e4198490 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69d800b4a0 tx=0x7f69d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:53.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.343+0000 7f69e17fa640 1 -- 172.21.15.73:0/1281261909 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8014070 con 0x7f69e4101d10 2024-09-10T07:48:53.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.343+0000 7f69e17fa640 1 -- 172.21.15.73:0/1281261909 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69d8010af0 con 0x7f69e4101d10 2024-09-10T07:48:53.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.343+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e419fe70 con 0x7f69e4101d10 2024-09-10T07:48:53.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.343+0000 7f69e17fa640 1 -- 172.21.15.73:0/1281261909 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8017d10 con 0x7f69e4101d10 2024-09-10T07:48:53.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.343+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e41a03a0 con 0x7f69e4101d10 2024-09-10T07:48:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.344+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e41a0630 con 0x7f69e4101d10 2024-09-10T07:48:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.345+0000 7f69e17fa640 1 -- 172.21.15.73:0/1281261909 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f69d8017070 con 0x7f69e4101d10 2024-09-10T07:48:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.345+0000 7f69e17fa640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69cc0a2c40 0x7f69cc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.345+0000 7f69e3fff640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69cc0a2c40 0x7f69cc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.346+0000 7f69e17fa640 1 -- 172.21.15.73:0/1281261909 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f69d80ce470 con 0x7f69e4101d10 2024-09-10T07:48:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.346+0000 7f69e3fff640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69cc0a2c40 0x7f69cc0a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f69d4005fd0 tx=0x7f69d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:53.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.350+0000 7f69e17fa640 1 -- 172.21.15.73:0/1281261909 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69d809b320 con 0x7f69e4101d10 2024-09-10T07:48:53.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.553+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f69e41a0800 con 0x7f69e4101d10 2024-09-10T07:48:53.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.553+0000 7f69e17fa640 1 -- 172.21.15.73:0/1281261909 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+3048 (secure 0 0 0) 0x7f69d809ac20 con 0x7f69e4101d10 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout:e19 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout:btime 2024-09-10T07:47:42:148674+0000 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 19 2024-09-10T07:48:53.553 INFO:teuthology.orchestra.run.smithi073.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-10T07:47:32.394994+0000 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-09-10T07:47:41.846317+0000 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 300 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 0 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T07:48:53.554 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=24485} 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data disabled 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 0 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 24485 members: 24485 2024-09-10T07:48:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b{0:24485} state up:active seq 4 addr [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.h{0:24464} state up:standby-replay seq 1 addr [v2:172.21.15.102:6836/801459300,v1:172.21.15.102:6837/801459300] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.j{-1:14532} state up:standby seq 1 addr [v2:172.21.15.73:6834/2591378942,v1:172.21.15.73:6835/2591378942] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d{-1:14544} state up:standby seq 1 addr [v2:172.21.15.73:6836/960559845,v1:172.21.15.73:6837/960559845] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.g{-1:14595} state up:standby seq 1 addr [v2:172.21.15.73:6838/3892628797,v1:172.21.15.73:6839/3892628797] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a{-1:14607} state up:standby seq 1 addr [v2:172.21.15.73:6840/1022312425,v1:172.21.15.73:6841/1022312425] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.l{-1:24397} state up:standby seq 1 addr [v2:172.21.15.159:6832/4146480241,v1:172.21.15.159:6833/4146480241] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.k{-1:24413} state up:standby seq 1 addr [v2:172.21.15.102:6832/440517114,v1:172.21.15.102:6833/440517114] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f{-1:24424} state up:standby seq 1 addr [v2:172.21.15.159:6834/3867563502,v1:172.21.15.159:6835/3867563502] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c{-1:24436} state up:standby seq 1 addr [v2:172.21.15.159:6836/1843594994,v1:172.21.15.159:6837/1843594994] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e{-1:24440} state up:standby seq 1 addr [v2:172.21.15.102:6834/2327482046,v1:172.21.15.102:6835/2327482046] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.557 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.i{-1:24457} state up:standby seq 1 addr [v2:172.21.15.159:6838/2574665327,v1:172.21.15.159:6839/2574665327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T07:48:53.557 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-10T07:48:53.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69cc0a2c40 msgr2=0x7f69cc0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:53.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69cc0a2c40 0x7f69cc0a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f69d4005fd0 tx=0x7f69d400b390 comp rx=0 tx=0).stop 2024-09-10T07:48:53.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e4101d10 msgr2=0x7f69e4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:53.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e4101d10 0x7f69e4198490 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69d800b4a0 tx=0x7f69d800b960 comp rx=0 tx=0).stop 2024-09-10T07:48:53.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 shutdown_connections 2024-09-10T07:48:53.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f69cc0a2c40 0x7f69cc0a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69e41026d0 0x7f69e419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69e4101d10 0x7f69e4198490 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 --2- 172.21.15.73:0/1281261909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e4100b10 0x7f69e4197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:53.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 >> 172.21.15.73:0/1281261909 conn(0x7f69e40fc2a0 msgr2=0x7f69e40fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:53.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 shutdown_connections 2024-09-10T07:48:53.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:53.555+0000 7f69ea358640 1 -- 172.21.15.73:0/1281261909 wait complete. 2024-09-10T07:48:54.035 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:53 smithi073 ceph-mon[30850]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:54.035 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:53 smithi073 ceph-mon[30850]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-10T07:48:54.036 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:53 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1281261909' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T07:48:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:53 smithi102 ceph-mon[35514]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:53 smithi102 ceph-mon[35514]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-10T07:48:54.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:53 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1281261909' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T07:48:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:53 smithi159 ceph-mon[35522]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:48:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:53 smithi159 ceph-mon[35522]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-10T07:48:54.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:53 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1281261909' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T07:48:54.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T07:48:54.457 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.897+0000 7fbf4c626640 1 -- 172.21.15.73:0/652420948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 msgr2=0x7fbf44108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.897+0000 7fbf4c626640 1 --2- 172.21.15.73:0/652420948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 0x7fbf44108f60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009ca0 tx=0x7fbf3c02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:48:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 -- 172.21.15.73:0/652420948 shutdown_connections 2024-09-10T07:48:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 --2- 172.21.15.73:0/652420948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 0x7fbf44108f60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 --2- 172.21.15.73:0/652420948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf44101d10 0x7fbf44102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 --2- 172.21.15.73:0/652420948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf44100b10 0x7fbf44100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 -- 172.21.15.73:0/652420948 >> 172.21.15.73:0/652420948 conn(0x7fbf440fc2a0 msgr2=0x7fbf440fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 -- 172.21.15.73:0/652420948 shutdown_connections 2024-09-10T07:48:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 -- 172.21.15.73:0/652420948 wait complete. 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 Processor -- start 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 -- start start 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf44100b10 0x7fbf44197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf44101d10 0x7fbf441983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 0x7fbf4419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4410c770 con 0x7fbf441026d0 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4410c5f0 con 0x7fbf44100b10 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.898+0000 7fbf4c626640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4410c8f0 con 0x7fbf44101d10 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4abc3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 0x7fbf4419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4abc3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 0x7fbf4419f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55616/0 (socket says 172.21.15.73:55616) 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4abc3640 1 -- 172.21.15.73:0/4004463648 learned_addr learned my addr 172.21.15.73:0/4004463648 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4a3c2640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf44100b10 0x7fbf44197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf49bc1640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf44101d10 0x7fbf441983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4abc3640 1 -- 172.21.15.73:0/4004463648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf44101d10 msgr2=0x7fbf441983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4abc3640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf44101d10 0x7fbf441983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4abc3640 1 -- 172.21.15.73:0/4004463648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf44100b10 msgr2=0x7fbf44197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4abc3640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf44100b10 0x7fbf44197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4abc3640 1 -- 172.21.15.73:0/4004463648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4419fae0 con 0x7fbf441026d0 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4a3c2640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf44100b10 0x7fbf44197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4abc3640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 0x7fbf4419f470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c031ae0 tx=0x7fbf3c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf377fe640 1 -- 172.21.15.73:0/4004463648 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c003c30 con 0x7fbf441026d0 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4419fd70 con 0x7fbf441026d0 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf377fe640 1 -- 172.21.15.73:0/4004463648 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf3c003dd0 con 0x7fbf441026d0 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf377fe640 1 -- 172.21.15.73:0/4004463648 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c02fcb0 con 0x7fbf441026d0 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.899+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf441a0250 con 0x7fbf441026d0 2024-09-10T07:48:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.900+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf441a0480 con 0x7fbf441026d0 2024-09-10T07:48:54.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.902+0000 7fbf377fe640 1 -- 172.21.15.73:0/4004463648 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbf3c004050 con 0x7fbf441026d0 2024-09-10T07:48:54.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.903+0000 7fbf377fe640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbf300a2c40 0x7fbf300a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:54.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.903+0000 7fbf4a3c2640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbf300a2c40 0x7fbf300a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:54.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.903+0000 7fbf377fe640 1 -- 172.21.15.73:0/4004463648 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7fbf3c0f0620 con 0x7fbf441026d0 2024-09-10T07:48:54.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.903+0000 7fbf4a3c2640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbf300a2c40 0x7fbf300a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf44101b70 tx=0x7fbf40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:54.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:54.906+0000 7fbf377fe640 1 -- 172.21.15.73:0/4004463648 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf3c0bd4d0 con 0x7fbf441026d0 2024-09-10T07:48:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.071+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fbf441a0770 con 0x7fbf441026d0 2024-09-10T07:48:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.071+0000 7fbf377fe640 1 -- 172.21.15.73:0/4004463648 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) ==== 56+0+5379 (secure 0 0 0) 0x7fbf3c0bcdd0 con 0x7fbf441026d0 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 85 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:fsid c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-10T07:39:59.865107+0000 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-09-10T07:48:46.743342+0000 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:crush_version 26 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:full_ratio 0.95 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:backfillfull_ratio 0.9 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:nearfull_ratio 0.85 2024-09-10T07:48:55.071 INFO:teuthology.orchestra.run.smithi073.stdout:require_min_compat_client luminous 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:min_compat_client luminous 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:require_osd_release squid 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:stretch_mode_enabled false 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.69 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:max_osd 12 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6802/2484484549,v1:172.21.15.73:6803/2484484549] [v2:172.21.15.73:6804/2484484549,v1:172.21.15.73:6805/2484484549] exists,up d6e507ac-4881-43ea-95a6-3df7feba2a89 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6800/2799530792,v1:172.21.15.102:6801/2799530792] [v2:172.21.15.102:6802/2799530792,v1:172.21.15.102:6803/2799530792] exists,up 5e703b50-3e28-499d-a8c4-4068826a16fb 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 up in weight 1 up_from 18 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6800/399686277,v1:172.21.15.159:6801/399686277] [v2:172.21.15.159:6802/399686277,v1:172.21.15.159:6803/399686277] exists,up 12fdc851-2a35-4284-8351-1e213d072217 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 up in weight 1 up_from 24 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6810/2078486916,v1:172.21.15.73:6811/2078486916] [v2:172.21.15.73:6812/2078486916,v1:172.21.15.73:6813/2078486916] exists,up 39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 up in weight 1 up_from 31 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6808/1176212807,v1:172.21.15.102:6809/1176212807] [v2:172.21.15.102:6810/1176212807,v1:172.21.15.102:6811/1176212807] exists,up 294eff0e-74d3-4a3c-a512-de8e6878e66d 2024-09-10T07:48:55.072 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 up in weight 1 up_from 36 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6808/877454458,v1:172.21.15.159:6809/877454458] [v2:172.21.15.159:6810/877454458,v1:172.21.15.159:6811/877454458] exists,up 71a0406f-9981-4c62-9795-e69112b5c4e0 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:osd.6 up in weight 1 up_from 43 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6818/3759904745,v1:172.21.15.73:6819/3759904745] [v2:172.21.15.73:6820/3759904745,v1:172.21.15.73:6821/3759904745] exists,up 495420b2-33d4-4278-9ed9-fec2371e2780 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:osd.7 up in weight 1 up_from 47 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6816/120865394,v1:172.21.15.102:6817/120865394] [v2:172.21.15.102:6818/120865394,v1:172.21.15.102:6819/120865394] exists,up 4674c7d2-204a-4a52-aaa8-0e242e9daa80 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:osd.8 up in weight 1 up_from 54 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6816/651574566,v1:172.21.15.159:6817/651574566] [v2:172.21.15.159:6818/651574566,v1:172.21.15.159:6819/651574566] exists,up c526c9b3-de80-4151-b6e2-2177cc83b83a 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:osd.9 up in weight 1 up_from 62 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6826/3756582500,v1:172.21.15.73:6827/3756582500] [v2:172.21.15.73:6828/3756582500,v1:172.21.15.73:6829/3756582500] exists,up de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:osd.10 up in weight 1 up_from 67 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6824/2640871897,v1:172.21.15.102:6825/2640871897] [v2:172.21.15.102:6826/2640871897,v1:172.21.15.102:6827/2640871897] exists,up 6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:osd.11 up in weight 1 up_from 75 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6824/1651446392,v1:172.21.15.159:6825/1651446392] [v2:172.21.15.159:6826/1651446392,v1:172.21.15.159:6827/1651446392] exists,up 6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 2.a [2,11] 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 2.b [8,11] 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 2.1d [2,1] 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 2.1f [8,4] 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.1 [4,9] 2024-09-10T07:48:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.2 [3,9] 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.12 [3,9] 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.1d [4,8] 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.28 [5,7] 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.31 [4,8] 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.39 [5,6] 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.3a [4,6] 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6801/142266274 expires 2024-09-11T07:40:44.582011+0000 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/601110519 expires 2024-09-11T07:40:44.582011+0000 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6800/142266274 expires 2024-09-11T07:40:44.582011+0000 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/1256602106 expires 2024-09-11T07:40:21.601749+0000 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/1519662291 expires 2024-09-11T07:40:21.601749+0000 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/3137884334 expires 2024-09-11T07:40:44.582011+0000 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/3218768954 expires 2024-09-11T07:40:44.582011+0000 2024-09-10T07:48:55.074 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6801/435372869 expires 2024-09-11T07:40:21.601749+0000 2024-09-10T07:48:55.075 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6800/435372869 expires 2024-09-11T07:40:21.601749+0000 2024-09-10T07:48:55.075 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/1886740002 expires 2024-09-11T07:40:21.601749+0000 2024-09-10T07:48:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.073+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbf300a2c40 msgr2=0x7fbf300a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.073+0000 7fbf4c626640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbf300a2c40 0x7fbf300a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf44101b70 tx=0x7fbf40005f90 comp rx=0 tx=0).stop 2024-09-10T07:48:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.073+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 msgr2=0x7fbf4419f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.073+0000 7fbf4c626640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 0x7fbf4419f470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c031ae0 tx=0x7fbf3c031ee0 comp rx=0 tx=0).stop 2024-09-10T07:48:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.074+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 shutdown_connections 2024-09-10T07:48:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.074+0000 7fbf4c626640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fbf300a2c40 0x7fbf300a5100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.074+0000 7fbf4c626640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf441026d0 0x7fbf4419f470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.074+0000 7fbf4c626640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf44101d10 0x7fbf441983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.074+0000 7fbf4c626640 1 --2- 172.21.15.73:0/4004463648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf44100b10 0x7fbf44197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.074+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 >> 172.21.15.73:0/4004463648 conn(0x7fbf440fc2a0 msgr2=0x7fbf440fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.074+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 shutdown_connections 2024-09-10T07:48:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:55.074+0000 7fbf4c626640 1 -- 172.21.15.73:0/4004463648 wait complete. 2024-09-10T07:48:55.749 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T07:48:55.760 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:48:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:56.123 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:55 smithi073 ceph-mon[30850]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-10T07:48:56.123 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:55 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/4004463648' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T07:48:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:55 smithi102 ceph-mon[35514]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-10T07:48:56.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:55 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/4004463648' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T07:48:56.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:55 smithi159 ceph-mon[35522]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-10T07:48:56.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:55 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/4004463648' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T07:48:56.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 -- 172.21.15.73:0/2219866277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48101036b0 msgr2=0x7f481010bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 --2- 172.21.15.73:0/2219866277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48101036b0 0x7f481010bba0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4800009900 tx=0x7f480002a480 comp rx=0 tx=0).stop 2024-09-10T07:48:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 -- 172.21.15.73:0/2219866277 shutdown_connections 2024-09-10T07:48:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 --2- 172.21.15.73:0/2219866277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f481010c170 0x7f481010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 --2- 172.21.15.73:0/2219866277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48101036b0 0x7f481010bba0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 --2- 172.21.15.73:0/2219866277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4810102d90 0x7f4810103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 -- 172.21.15.73:0/2219866277 >> 172.21.15.73:0/2219866277 conn(0x7f48100fc790 msgr2=0x7f48100febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 -- 172.21.15.73:0/2219866277 shutdown_connections 2024-09-10T07:48:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 -- 172.21.15.73:0/2219866277 wait complete. 2024-09-10T07:48:56.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 Processor -- start 2024-09-10T07:48:56.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.455+0000 7f481793f640 1 -- start start 2024-09-10T07:48:56.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f481793f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4810102d90 0x7f48101983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:56.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f481793f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48101036b0 0x7f4810198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:56.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f481793f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f481010c170 0x7f481019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:56.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f481793f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4810111f50 con 0x7f4810102d90 2024-09-10T07:48:56.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f481793f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4810111dd0 con 0x7f48101036b0 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f481793f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f48101120d0 con 0x7f481010c170 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48156db640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4810102d90 0x7f48101983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48156db640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4810102d90 0x7f48101983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55638/0 (socket says 172.21.15.73:55638) 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48156db640 1 -- 172.21.15.73:0/2567655815 learned_addr learned my addr 172.21.15.73:0/2567655815 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f4814eda640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48101036b0 0x7f4810198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f4815edc640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f481010c170 0x7f481019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48156db640 1 -- 172.21.15.73:0/2567655815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f481010c170 msgr2=0x7f481019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48156db640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f481010c170 0x7f481019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48156db640 1 -- 172.21.15.73:0/2567655815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48101036b0 msgr2=0x7f4810198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48156db640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48101036b0 0x7f4810198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48156db640 1 -- 172.21.15.73:0/2567655815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481019d3a0 con 0x7f4810102d90 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f4815edc640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f481010c170 0x7f481019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:48:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f4814eda640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48101036b0 0x7f4810198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:48:56.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48156db640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4810102d90 0x7f48101983f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f480800db80 tx=0x7f480800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:56.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48067fc640 1 -- 172.21.15.73:0/2567655815 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808017070 con 0x7f4810102d90 2024-09-10T07:48:56.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48067fc640 1 -- 172.21.15.73:0/2567655815 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4808003b70 con 0x7f4810102d90 2024-09-10T07:48:56.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481019d690 con 0x7f4810102d90 2024-09-10T07:48:56.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.456+0000 7f48067fc640 1 -- 172.21.15.73:0/2567655815 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48080106c0 con 0x7f4810102d90 2024-09-10T07:48:56.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.457+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48101a4f70 con 0x7f4810102d90 2024-09-10T07:48:56.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.458+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4810103170 con 0x7f4810102d90 2024-09-10T07:48:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.459+0000 7f48067fc640 1 -- 172.21.15.73:0/2567655815 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4808004020 con 0x7f4810102d90 2024-09-10T07:48:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.459+0000 7f48067fc640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f47fc0a2c10 0x7f47fc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.459+0000 7f4814eda640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f47fc0a2c10 0x7f47fc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.459+0000 7f48067fc640 1 -- 172.21.15.73:0/2567655815 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f48080cf090 con 0x7f4810102d90 2024-09-10T07:48:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.460+0000 7f4814eda640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f47fc0a2c10 0x7f47fc0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f48100fed90 tx=0x7f4800005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.463+0000 7f48067fc640 1 -- 172.21.15.73:0/2567655815 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4808020070 con 0x7f4810102d90 2024-09-10T07:48:56.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.662+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48101071b0 con 0x7f4810102d90 2024-09-10T07:48:56.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.663+0000 7f48067fc640 1 -- 172.21.15.73:0/2567655815 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11853 (secure 0 0 0) 0x7f480809be30 con 0x7f4810102d90 2024-09-10T07:48:56.663 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:56.663 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"btime":"2024-09-10T07:47:42:148674+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T07:47:32.394994+0000","modified":"2024-09-10T07:47:41.846317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6839/330469529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":330469529},{"type":"v1","addr":"172.21.15.102:6839","nonce":330469529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-10T07:48:56.663 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-10T07:48:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f47fc0a2c10 msgr2=0x7f47fc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f47fc0a2c10 0x7f47fc0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f48100fed90 tx=0x7f4800005a20 comp rx=0 tx=0).stop 2024-09-10T07:48:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4810102d90 msgr2=0x7f48101983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4810102d90 0x7f48101983f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f480800db80 tx=0x7f480800b630 comp rx=0 tx=0).stop 2024-09-10T07:48:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 shutdown_connections 2024-09-10T07:48:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f47fc0a2c10 0x7f47fc0a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f481010c170 0x7f481019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48101036b0 0x7f4810198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 --2- 172.21.15.73:0/2567655815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4810102d90 0x7f48101983f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 >> 172.21.15.73:0/2567655815 conn(0x7f48100fc790 msgr2=0x7f48100fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 shutdown_connections 2024-09-10T07:48:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:56.665+0000 7f481793f640 1 -- 172.21.15.73:0/2567655815 wait complete. 2024-09-10T07:48:56.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:56 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2567655815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:57.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:56 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2567655815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:57.156 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:56 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2567655815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:57.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:48:57.537 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:57.911 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:57 smithi073 ceph-mon[30850]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:48:58.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.987+0000 7f486eb0b640 1 -- 172.21.15.73:0/3092915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868101de0 msgr2=0x7f48681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.987+0000 7f486eb0b640 1 --2- 172.21.15.73:0/3092915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868101de0 0x7f48681021c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f485c009900 tx=0x7f485c02a410 comp rx=0 tx=0).stop 2024-09-10T07:48:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.988+0000 7f486eb0b640 1 -- 172.21.15.73:0/3092915 shutdown_connections 2024-09-10T07:48:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.988+0000 7f486eb0b640 1 --2- 172.21.15.73:0/3092915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868106f10 0x7f486810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.988+0000 7f486eb0b640 1 --2- 172.21.15.73:0/3092915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4868102790 0x7f48681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.988+0000 7f486eb0b640 1 --2- 172.21.15.73:0/3092915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868101de0 0x7f48681021c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.988+0000 7f486eb0b640 1 -- 172.21.15.73:0/3092915 >> 172.21.15.73:0/3092915 conn(0x7f48680fd8c0 msgr2=0x7f48680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.988+0000 7f486eb0b640 1 -- 172.21.15.73:0/3092915 shutdown_connections 2024-09-10T07:48:58.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.988+0000 7f486eb0b640 1 -- 172.21.15.73:0/3092915 wait complete. 2024-09-10T07:48:58.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.988+0000 7f486eb0b640 1 Processor -- start 2024-09-10T07:48:58.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.988+0000 7f486eb0b640 1 -- start start 2024-09-10T07:48:58.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486eb0b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4868101de0 0x7f4868198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:58.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486eb0b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868102790 0x7f48681989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486eb0b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868106f10 0x7f486819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486eb0b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4868111f90 con 0x7f4868106f10 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486eb0b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4868111e10 con 0x7f4868101de0 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486eb0b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4868112110 con 0x7f4868102790 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486d0a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868106f10 0x7f486819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486d0a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868106f10 0x7f486819cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55648/0 (socket says 172.21.15.73:55648) 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486d0a8640 1 -- 172.21.15.73:0/2678628142 learned_addr learned my addr 172.21.15.73:0/2678628142 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486c8a7640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4868101de0 0x7f4868198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f4867fff640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868102790 0x7f48681989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486d0a8640 1 -- 172.21.15.73:0/2678628142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868102790 msgr2=0x7f48681989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486d0a8640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868102790 0x7f48681989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486d0a8640 1 -- 172.21.15.73:0/2678628142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4868101de0 msgr2=0x7f4868198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486d0a8640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4868101de0 0x7f4868198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486d0a8640 1 -- 172.21.15.73:0/2678628142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486819d430 con 0x7f4868106f10 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486d0a8640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868106f10 0x7f486819cd50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f486000b970 tx=0x7f486000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f4865ffb640 1 -- 172.21.15.73:0/2678628142 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860019070 con 0x7f4868106f10 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f4865ffb640 1 -- 172.21.15.73:0/2678628142 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f486000cb40 con 0x7f4868106f10 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486819d720 con 0x7f4868106f10 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.989+0000 7f4865ffb640 1 -- 172.21.15.73:0/2678628142 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860007650 con 0x7f4868106f10 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.990+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48681a5000 con 0x7f4868106f10 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.990+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48681021c0 con 0x7f4868106f10 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.991+0000 7f4865ffb640 1 -- 172.21.15.73:0/2678628142 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f486001c070 con 0x7f4868106f10 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.992+0000 7f4865ffb640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f48580a2c90 0x7f48580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.992+0000 7f486c8a7640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f48580a2c90 0x7f48580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.992+0000 7f4865ffb640 1 -- 172.21.15.73:0/2678628142 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f48600ce650 con 0x7f4868106f10 2024-09-10T07:48:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.992+0000 7f486c8a7640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f48580a2c90 0x7f48580a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f485c009230 tx=0x7f485c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:57.996+0000 7f4865ffb640 1 -- 172.21.15.73:0/2678628142 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f486009aeb0 con 0x7f4868106f10 2024-09-10T07:48:58.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:57 smithi102 ceph-mon[35514]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:48:58.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:57 smithi159 ceph-mon[35522]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:48:58.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.198+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f486810a120 con 0x7f4868106f10 2024-09-10T07:48:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.198+0000 7f4865ffb640 1 -- 172.21.15.73:0/2678628142 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11853 (secure 0 0 0) 0x7f486009f1b0 con 0x7f4868106f10 2024-09-10T07:48:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:58.198 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"btime":"2024-09-10T07:47:42:148674+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T07:47:32.394994+0000","modified":"2024-09-10T07:47:41.846317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6839/330469529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":330469529},{"type":"v1","addr":"172.21.15.102:6839","nonce":330469529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-10T07:48:58.199 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-10T07:48:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f48580a2c90 msgr2=0x7f48580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f48580a2c90 0x7f48580a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f485c009230 tx=0x7f485c0058d0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868106f10 msgr2=0x7f486819cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868106f10 0x7f486819cd50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f486000b970 tx=0x7f486000be30 comp rx=0 tx=0).stop 2024-09-10T07:48:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 shutdown_connections 2024-09-10T07:48:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f48580a2c90 0x7f48580a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4868106f10 0x7f486819cd50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868102790 0x7f48681989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 --2- 172.21.15.73:0/2678628142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4868101de0 0x7f4868198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 >> 172.21.15.73:0/2678628142 conn(0x7f48680fd8c0 msgr2=0x7f48680fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 shutdown_connections 2024-09-10T07:48:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:58.201+0000 7f486eb0b640 1 -- 172.21.15.73:0/2678628142 wait complete. 2024-09-10T07:48:58.783 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T07:48:58.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:58 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2678628142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:59.028 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:48:59.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:58 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2678628142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:58 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2678628142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.471+0000 7fa56d1dd640 1 -- 172.21.15.73:0/184354148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568101430 msgr2=0x7fa56810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.471+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/184354148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568101430 0x7fa56810d960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa560009cd0 tx=0x7fa56002a8e0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.471+0000 7fa56d1dd640 1 -- 172.21.15.73:0/184354148 shutdown_connections 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.471+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/184354148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568101430 0x7fa56810d960 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.471+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/184354148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568100a90 0x7fa568100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.471+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/184354148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa568106a90 0x7fa568106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.471+0000 7fa56d1dd640 1 -- 172.21.15.73:0/184354148 >> 172.21.15.73:0/184354148 conn(0x7fa5680fc7d0 msgr2=0x7fa5680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.471+0000 7fa56d1dd640 1 -- 172.21.15.73:0/184354148 shutdown_connections 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.471+0000 7fa56d1dd640 1 -- 172.21.15.73:0/184354148 wait complete. 2024-09-10T07:48:59.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.472+0000 7fa56d1dd640 1 Processor -- start 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.472+0000 7fa56d1dd640 1 -- start start 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.472+0000 7fa56d1dd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa568100a90 0x7fa568198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.472+0000 7fa56d1dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101430 0x7fa568198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.472+0000 7fa56d1dd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568106a90 0x7fa56819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.472+0000 7fa56d1dd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa568110eb0 con 0x7fa568106a90 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.472+0000 7fa56d1dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa568110d30 con 0x7fa568101430 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.472+0000 7fa56d1dd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa568111030 con 0x7fa568100a90 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.472+0000 7fa56759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568106a90 0x7fa56819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568106a90 0x7fa56819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55674/0 (socket says 172.21.15.73:55674) 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56759e640 1 -- 172.21.15.73:0/1903358141 learned_addr learned my addr 172.21.15.73:0/1903358141 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56659c640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101430 0x7fa568198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa566d9d640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa568100a90 0x7fa568198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56759e640 1 -- 172.21.15.73:0/1903358141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa568100a90 msgr2=0x7fa568198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56759e640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa568100a90 0x7fa568198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56759e640 1 -- 172.21.15.73:0/1903358141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101430 msgr2=0x7fa568198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56759e640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101430 0x7fa568198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56759e640 1 -- 172.21.15.73:0/1903358141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56819d3f0 con 0x7fa568106a90 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56759e640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568106a90 0x7fa56819cd10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa560006010 tx=0x7fa560003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa54ffff640 1 -- 172.21.15.73:0/1903358141 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560004450 con 0x7fa568106a90 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56819d680 con 0x7fa568106a90 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa54ffff640 1 -- 172.21.15.73:0/1903358141 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa560003e10 con 0x7fa568106a90 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa54ffff640 1 -- 172.21.15.73:0/1903358141 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560046480 con 0x7fa568106a90 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.473+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5681a4fc0 con 0x7fa568106a90 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.474+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa568100ef0 con 0x7fa568106a90 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.475+0000 7fa54ffff640 1 -- 172.21.15.73:0/1903358141 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa5600045f0 con 0x7fa568106a90 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.476+0000 7fa54ffff640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5500a2c10 0x7fa5500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.476+0000 7fa566d9d640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5500a2c10 0x7fa5500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:48:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.476+0000 7fa54ffff640 1 -- 172.21.15.73:0/1903358141 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7fa56002e030 con 0x7fa568106a90 2024-09-10T07:48:59.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.476+0000 7fa566d9d640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5500a2c10 0x7fa5500a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa55800abe0 tx=0x7fa55800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:48:59.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.480+0000 7fa54ffff640 1 -- 172.21.15.73:0/1903358141 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa56004b060 con 0x7fa568106a90 2024-09-10T07:48:59.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.651+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa56810a030 con 0x7fa568106a90 2024-09-10T07:48:59.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.652+0000 7fa54ffff640 1 -- 172.21.15.73:0/1903358141 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22952 (secure 0 0 0) 0x7fa5600bd8c0 con 0x7fa568106a90 2024-09-10T07:48:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:48:59.742 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:48:46.743342+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:47:28.792230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:47:30.666653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:48:59.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5500a2c10 msgr2=0x7fa5500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5500a2c10 0x7fa5500a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa55800abe0 tx=0x7fa55800a2d0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568106a90 msgr2=0x7fa56819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568106a90 0x7fa56819cd10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa560006010 tx=0x7fa560003c20 comp rx=0 tx=0).stop 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 shutdown_connections 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7fa5500a2c10 0x7fa5500a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa568106a90 0x7fa56819cd10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101430 0x7fa568198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 --2- 172.21.15.73:0/1903358141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa568100a90 0x7fa568198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.654+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 >> 172.21.15.73:0/1903358141 conn(0x7fa5680fc7d0 msgr2=0x7fa56806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.655+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 shutdown_connections 2024-09-10T07:48:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:48:59.655+0000 7fa56d1dd640 1 -- 172.21.15.73:0/1903358141 wait complete. 2024-09-10T07:49:00.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:59 smithi102 ceph-mon[35514]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:49:00.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:48:59 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1903358141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:49:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:59 smithi159 ceph-mon[35522]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:49:00.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:48:59 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1903358141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:49:00.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:59 smithi073 ceph-mon[30850]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:49:00.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:48:59 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1903358141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:49:00.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T07:47:32.394994+0000', 'modified': '2024-09-10T07:47:41.846317+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6837/801459300', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 801459300}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 801459300}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.102:6839/330469529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 330469529}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 330469529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24485, 'qdb_cluster': [24485]} 2024-09-10T07:49:00.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:49:00.294 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T07:49:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:49:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 -- 172.21.15.73:0/3623293670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 msgr2=0x7f416810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 --2- 172.21.15.73:0/3623293670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 0x7f416810da40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4160009ca0 tx=0x7f416002a950 comp rx=0 tx=0).stop 2024-09-10T07:49:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 -- 172.21.15.73:0/3623293670 shutdown_connections 2024-09-10T07:49:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 --2- 172.21.15.73:0/3623293670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 0x7f416810da40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 --2- 172.21.15.73:0/3623293670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168102570 0x7f41681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 --2- 172.21.15.73:0/3623293670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4168100e20 0x7f4168101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 -- 172.21.15.73:0/3623293670 >> 172.21.15.73:0/3623293670 conn(0x7f41680fc7d0 msgr2=0x7f41680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 -- 172.21.15.73:0/3623293670 shutdown_connections 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 -- 172.21.15.73:0/3623293670 wait complete. 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 Processor -- start 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.990+0000 7f416e730640 1 -- start start 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416e730640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4168100e20 0x7f41681983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416e730640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168102570 0x7f4168198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416e730640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 0x7f416819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416e730640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4168110f80 con 0x7f4168102ef0 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416e730640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4168110e00 con 0x7f4168102570 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416e730640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4168111100 con 0x7f4168100e20 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416cccd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 0x7f416819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416cccd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 0x7f416819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49928/0 (socket says 172.21.15.73:49928) 2024-09-10T07:49:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416cccd640 1 -- 172.21.15.73:0/2897169948 learned_addr learned my addr 172.21.15.73:0/2897169948 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f41677fe640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168102570 0x7f4168198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f4167fff640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4168100e20 0x7f41681983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416cccd640 1 -- 172.21.15.73:0/2897169948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4168100e20 msgr2=0x7f41681983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416cccd640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4168100e20 0x7f41681983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416cccd640 1 -- 172.21.15.73:0/2897169948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168102570 msgr2=0x7f4168198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416cccd640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168102570 0x7f4168198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416cccd640 1 -- 172.21.15.73:0/2897169948 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416819d390 con 0x7f4168102ef0 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f41677fe640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168102570 0x7f4168198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f4167fff640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4168100e20 0x7f41681983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416cccd640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 0x7f416819ccb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4160006010 tx=0x7f416002f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f41657fa640 1 -- 172.21.15.73:0/2897169948 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160034040 con 0x7f4168102ef0 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f41657fa640 1 -- 172.21.15.73:0/2897169948 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4160003e00 con 0x7f4168102ef0 2024-09-10T07:49:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416e730640 1 -- 172.21.15.73:0/2897169948 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416819d620 con 0x7f4168102ef0 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f41657fa640 1 -- 172.21.15.73:0/2897169948 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160045480 con 0x7f4168102ef0 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.991+0000 7f416e730640 1 -- 172.21.15.73:0/2897169948 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41681a4f60 con 0x7f4168102ef0 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.993+0000 7f41657fa640 1 -- 172.21.15.73:0/2897169948 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4160037020 con 0x7f4168102ef0 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f4170b09740 1 Processor -- start 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f4170b09740 1 -- start start 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f41657fa640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f41500a2c10 0x7f41500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f4170b09740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 0x55fe59fe8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f4170b09740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 0x55fe59ff7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f4170b09740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ffa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f4170b09740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fe59f4f090 con 0x55fe59ff7fc0 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f4170b09740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fe59ef6a70 con 0x55fe59fe91d0 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f4170b09740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fe59f4b050 con 0x55fe59fe88b0 2024-09-10T07:49:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f41677fe640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f41500a2c10 0x7f41500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f416cccd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ffa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f41657fa640 1 -- 172.21.15.73:0/2897169948 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f41600f0340 con 0x7f4168102ef0 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.994+0000 7f416cccd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ffa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49936/0 (socket says 172.21.15.73:49936) 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f416cccd640 1 -- 172.21.15.73:0/3355513814 learned_addr learned my addr 172.21.15.73:0/3355513814 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f41677fe640 1 --2- 172.21.15.73:0/3355513814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 0x55fe59ff7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f4167fff640 1 --2- 172.21.15.73:0/3355513814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 0x55fe59fe8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f416cccd640 1 -- 172.21.15.73:0/3355513814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 msgr2=0x55fe59fe8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f416cccd640 1 --2- 172.21.15.73:0/3355513814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 0x55fe59fe8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f416cccd640 1 -- 172.21.15.73:0/3355513814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 msgr2=0x55fe59ff7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:49:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f416cccd640 1 --2- 172.21.15.73:0/3355513814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 0x55fe59ff7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f416cccd640 1 -- 172.21.15.73:0/3355513814 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe59f03130 con 0x55fe59ff7fc0 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f41677fe640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f41500a2c10 0x7f41500a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f415c005fd0 tx=0x7f415c0128d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f416cccd640 1 --2- 172.21.15.73:0/3355513814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ffa3b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f41600b94c0 tx=0x7f4160004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358fcce6116ba6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f414e7fc640 1 -- 172.21.15.73:0/3355513814 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416002c040 con 0x55fe59ff7fc0 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f414e7fc640 1 -- 172.21.15.73:0/3355513814 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41600bcaf0 con 0x55fe59ff7fc0 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.995+0000 7f414e7fc640 1 -- 172.21.15.73:0/3355513814 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160004040 con 0x55fe59ff7fc0 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 -- 172.21.15.73:0/3355513814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 msgr2=0x55fe59ffa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 --2- 172.21.15.73:0/3355513814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ffa3b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f41600b94c0 tx=0x7f4160004480 comp rx=0 tx=0).stop 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 -- 172.21.15.73:0/3355513814 shutdown_connections 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 --2- 172.21.15.73:0/3355513814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ffa3b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 --2- 172.21.15.73:0/3355513814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 0x55fe59ff7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 --2- 172.21.15.73:0/3355513814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 0x55fe59fe8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 -- 172.21.15.73:0/3355513814 >> 172.21.15.73:0/3355513814 conn(0x55fe59fe4f60 msgr2=0x55fe59fe5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 -- 172.21.15.73:0/3355513814 shutdown_connections 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 -- 172.21.15.73:0/3355513814 wait complete. 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 -- start start 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.996+0000 7f4170b09740 1 Processor -- start 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f4170b09740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 0x55fe59ff78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f4170b09740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe91d0 0x55fe59ff4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f4170b09740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f4170b09740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fe59ffa950 con 0x55fe59ff7fc0 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f4170b09740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fe59f09f20 con 0x55fe59fe88b0 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f4170b09740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fe59ffaad0 con 0x55fe59fe91d0 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f4170b09740 10 client.0 _ll_register_callbacks cb 0x55fe59ed3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f416cccd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f416cccd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49948/0 (socket says 172.21.15.73:49948) 2024-09-10T07:49:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f416cccd640 1 -- 172.21.15.73:0/575778044 learned_addr learned my addr 172.21.15.73:0/575778044 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f4167fff640 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 0x55fe59ff78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f41677fe640 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe91d0 0x55fe59ff4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f416cccd640 1 -- 172.21.15.73:0/575778044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe91d0 msgr2=0x55fe59ff4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:49:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f416cccd640 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe91d0 0x55fe59ff4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f416cccd640 1 -- 172.21.15.73:0/575778044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 msgr2=0x55fe59ff78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:49:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f416cccd640 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 0x55fe59ff78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f416cccd640 1 -- 172.21.15.73:0/575778044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe59cc02b0 con 0x55fe59ff7fc0 2024-09-10T07:49:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f41677fe640 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe91d0 0x55fe59ff4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f416cccd640 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff5160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f41600ede20 tx=0x7f41600b9390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f91d8d9c25b589 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f41477fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f41477fe640 1 -- 172.21.15.73:0/575778044 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416002c040 con 0x55fe59ff7fc0 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f41477fe640 1 -- 172.21.15.73:0/575778044 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f41600bcd50 con 0x55fe59ff7fc0 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.997+0000 7f4170b09740 1 -- 172.21.15.73:0/575778044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41600bcaf0 con 0x55fe59ff7fc0 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f41477fe640 1 -- 172.21.15.73:0/575778044 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f41600c5760 con 0x55fe59ff7fc0 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f4170b09740 10 client.15036 fetch_fsmap learned FSMap version 19 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f4170b09740 1 -- 172.21.15.73:0/575778044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fe59ffa950 con 0x55fe59ff7fc0 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f41477fe640 1 -- 172.21.15.73:0/575778044 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41600bcaf0 con 0x55fe59ff7fc0 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f41477fe640 1 -- 172.21.15.73:0/575778044 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f416003c6a0 con 0x55fe59ff7fc0 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f4170b09740 10 client.15036 fetch_fsmap finished waiting for FSMap version 19 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f4170b09740 10 client.15036 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T07:49:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f4170b09740 20 client.15036 populate_metadata read hostname 'smithi073' 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f4170b09740 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55fe5a008790 0x55fe5a009c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f4170b09740 4 client.15036 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f4170b09740 1 -- 172.21.15.73:0/575778044 --> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe59f5c600 con 0x55fe5a008790 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.998+0000 7f4167fff640 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55fe5a008790 0x55fe5a009c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.999+0000 7f41477fe640 10 client.15036 ms_handle_connect on v2:172.21.15.102:6838/330469529 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:00.999+0000 7f4167fff640 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55fe5a008790 0x55fe5a009c00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66a9dd4f995b5908 server_cookie=85730338ede76de8 in_seq=0 out_seq=0 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f41477fe640 1 -- 172.21.15.73:0/575778044 <== mds.0 v2:172.21.15.102:6838/330469529 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe59f5c600 con 0x55fe5a008790 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f41477fe640 10 client.15036 handle_command_reply: tid=0 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 client.15036 shutdown 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 -- 172.21.15.73:0/575778044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 msgr2=0x55fe59ff5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff5160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f41600ede20 tx=0x7f41600b9390 comp rx=0 tx=0).stop 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 -- 172.21.15.73:0/575778044 shutdown_connections 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55fe5a008790 0x55fe5a009c00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff5160 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe91d0 0x55fe59ff4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f41477fe640 0 client.15036 ms_handle_reset on v2:172.21.15.102:6838/330469529 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 --2- 172.21.15.73:0/575778044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 0x55fe59ff78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 -- 172.21.15.73:0/575778044 >> 172.21.15.73:0/575778044 conn(0x55fe59fe4f60 msgr2=0x55fe59feacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 -- 172.21.15.73:0/575778044 shutdown_connections 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 1 -- 172.21.15.73:0/575778044 wait complete. 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.000+0000 7f4170b09740 20 client.15036 trim_cache size 0 max 16384 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.017+0000 7f4170b09740 1 Processor -- start 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.017+0000 7f4170b09740 1 -- start start 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.017+0000 7f4170b09740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 0x55fe5a0080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.017+0000 7f4170b09740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 0x55fe5a009c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.017+0000 7f4170b09740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.017+0000 7f4170b09740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fe5a007f40 con 0x55fe59ff7fc0 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.017+0000 7f4170b09740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fe5a008610 con 0x55fe59fe91d0 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.017+0000 7f4170b09740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fe5a008ce0 con 0x55fe59fe88b0 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f416cccd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f416cccd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49950/0 (socket says 172.21.15.73:49950) 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f416cccd640 1 -- 172.21.15.73:0/1918546427 learned_addr learned my addr 172.21.15.73:0/1918546427 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f4167fff640 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 0x55fe5a0080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f41677fe640 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 0x55fe5a009c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f416cccd640 1 -- 172.21.15.73:0/1918546427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 msgr2=0x55fe5a0080c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f416cccd640 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 0x55fe5a0080c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f416cccd640 1 -- 172.21.15.73:0/1918546427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 msgr2=0x55fe5a009c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f416cccd640 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 0x55fe5a009c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f416cccd640 1 -- 172.21.15.73:0/1918546427 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe59ff7c40 con 0x55fe59ff7fc0 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f41677fe640 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 0x55fe5a009c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:49:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f4167fff640 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 0x55fe5a0080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f416cccd640 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff0130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f416002fdd0 tx=0x7f4160004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8a8ca5a6090cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f414dffb640 1 -- 172.21.15.73:0/1918546427 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416002c040 con 0x55fe59ff7fc0 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f414dffb640 1 -- 172.21.15.73:0/1918546427 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41600baeb0 con 0x55fe59ff7fc0 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.018+0000 7f414dffb640 1 -- 172.21.15.73:0/1918546427 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600c0ea0 con 0x55fe59ff7fc0 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 -- 172.21.15.73:0/1918546427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 msgr2=0x55fe59ff0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff0130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f416002fdd0 tx=0x7f4160004480 comp rx=0 tx=0).stop 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 -- 172.21.15.73:0/1918546427 shutdown_connections 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59ff7fc0 0x55fe59ff0130 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe91d0 0x55fe5a009c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 --2- 172.21.15.73:0/1918546427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59fe88b0 0x55fe5a0080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 -- 172.21.15.73:0/1918546427 >> 172.21.15.73:0/1918546427 conn(0x55fe59fe4f60 msgr2=0x55fe59fefa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 -- 172.21.15.73:0/1918546427 shutdown_connections 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 -- 172.21.15.73:0/1918546427 wait complete. 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.019+0000 7f4170b09740 1 -- start start 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f4170b09740 1 Processor -- start 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f4170b09740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 0x55fe5a00b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f4170b09740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59fe91d0 0x55fe5a00b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f4170b09740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59ff7fc0 0x55fe5a070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f4170b09740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fe5a009a80 con 0x55fe59fe91d0 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f4170b09740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fe5a0093b0 con 0x55fe59fe88b0 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f4170b09740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fe5a00a150 con 0x55fe59ff7fc0 2024-09-10T07:49:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f4170b09740 10 client.0 _ll_register_callbacks cb 0x7f415c00aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41677fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59fe91d0 0x55fe5a00b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41677fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59fe91d0 0x55fe5a00b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49958/0 (socket says 172.21.15.73:49958) 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41677fe640 1 -- 172.21.15.73:0/1782900080 learned_addr learned my addr 172.21.15.73:0/1782900080 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f4167fff640 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 0x55fe5a00b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41677fe640 1 -- 172.21.15.73:0/1782900080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59ff7fc0 msgr2=0x55fe5a070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41677fe640 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59ff7fc0 0x55fe5a070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41677fe640 1 -- 172.21.15.73:0/1782900080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 msgr2=0x55fe5a00b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41677fe640 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 0x55fe5a00b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41677fe640 1 -- 172.21.15.73:0/1782900080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe5a0713d0 con 0x55fe59fe91d0 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41677fe640 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59fe91d0 0x55fe5a00b890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f415c00a6e0 tx=0x7f415c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1cb51690f7de9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41477fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.020+0000 7f41477fe640 1 -- 172.21.15.73:0/1782900080 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c02d060 con 0x55fe59fe91d0 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4170b09740 1 -- 172.21.15.73:0/1782900080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe59f56b10 con 0x55fe59fe91d0 2024-09-10T07:49:01.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f41477fe640 1 -- 172.21.15.73:0/1782900080 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f415c01e670 con 0x55fe59fe91d0 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f41477fe640 1 -- 172.21.15.73:0/1782900080 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f415c01e870 con 0x55fe59fe91d0 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4170b09740 10 client.15042 fetch_fsmap learned FSMap version 19 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4170b09740 1 -- 172.21.15.73:0/1782900080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fe5a072540 con 0x55fe59fe91d0 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f41477fe640 1 -- 172.21.15.73:0/1782900080 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55fe59f56b10 con 0x55fe59fe91d0 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f41477fe640 1 -- 172.21.15.73:0/1782900080 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f415c031030 con 0x55fe59fe91d0 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4170b09740 10 client.15042 fetch_fsmap finished waiting for FSMap version 19 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4170b09740 10 client.15042 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4170b09740 20 client.15042 populate_metadata read hostname 'smithi073' 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4170b09740 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55fe5a077170 0x55fe5a075e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4170b09740 4 client.15042 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:49:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4170b09740 1 -- 172.21.15.73:0/1782900080 --> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] -- command(tid 0: {"prefix": "status"}) -- 0x55fe59ed30e0 con 0x55fe5a077170 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "c025e280-6f47-11ef-bcea-c7b262605968", 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24485, 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 87.903196120000004, 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 19, 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 81, 2024-09-10T07:49:01.052 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 98.479527001999998 2024-09-10T07:49:01.053 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T07:49:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.021+0000 7f4167fff640 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55fe5a077170 0x55fe5a075e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4167fff640 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55fe5a077170 0x55fe5a075e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69e069f9711b0378 server_cookie=3365534934e967c4 in_seq=0 out_seq=0 2024-09-10T07:49:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f41477fe640 10 client.15042 ms_handle_connect on v2:172.21.15.102:6838/330469529 2024-09-10T07:49:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f41477fe640 1 -- 172.21.15.73:0/1782900080 <== mds.0 v2:172.21.15.102:6838/330469529 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fe59ed30e0 con 0x55fe5a077170 2024-09-10T07:49:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f41477fe640 10 client.15042 handle_command_reply: tid=0 2024-09-10T07:49:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 client.15042 shutdown 2024-09-10T07:49:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 -- 172.21.15.73:0/1782900080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59fe91d0 msgr2=0x55fe5a00b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59fe91d0 0x55fe5a00b890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f415c00a6e0 tx=0x7f415c018000 comp rx=0 tx=0).stop 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 -- 172.21.15.73:0/1782900080 shutdown_connections 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.102:6838/330469529,v1:172.21.15.102:6839/330469529] conn(0x55fe5a077170 0x55fe5a075e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe59ff7fc0 0x55fe5a070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe59fe91d0 0x55fe5a00b890 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 --2- 172.21.15.73:0/1782900080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fe59fe88b0 0x55fe5a00b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 -- 172.21.15.73:0/1782900080 >> 172.21.15.73:0/1782900080 conn(0x55fe59fe4f60 msgr2=0x55fe59fea3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f41477fe640 0 client.15042 ms_handle_reset on v2:172.21.15.102:6838/330469529 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 -- 172.21.15.73:0/1782900080 shutdown_connections 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 1 -- 172.21.15.73:0/1782900080 wait complete. 2024-09-10T07:49:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.022+0000 7f4170b09740 20 client.15042 trim_cache size 0 max 16384 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 -- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f41500a2c10 msgr2=0x7f41500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f41500a2c10 0x7f41500a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f415c005fd0 tx=0x7f415c0128d0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 -- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 msgr2=0x7f416819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 0x7f416819ccb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4160006010 tx=0x7f416002f6f0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 -- 172.21.15.73:0/2897169948 shutdown_connections 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f41500a2c10 0x7f41500a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4168102ef0 0x7f416819ccb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168102570 0x7f4168198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 --2- 172.21.15.73:0/2897169948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4168100e20 0x7f41681983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 -- 172.21.15.73:0/2897169948 >> 172.21.15.73:0/2897169948 conn(0x7f41680fc7d0 msgr2=0x7f416806a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 -- 172.21.15.73:0/2897169948 shutdown_connections 2024-09-10T07:49:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.023+0000 7f416e730640 1 -- 172.21.15.73:0/2897169948 wait complete. 2024-09-10T07:49:01.703 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T07:49:01.713 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T07:49:01.713 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T07:49:01.714 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T07:49:01.714 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-10T07:49:01.715 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T07:49:01.715 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T07:49:01.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 -- 172.21.15.73:0/3626606904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 msgr2=0x7f9ae4109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/3626606904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 0x7f9ae4109fa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009ca0 tx=0x7f9adc02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 -- 172.21.15.73:0/3626606904 shutdown_connections 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/3626606904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 0x7f9ae4109fa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/3626606904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ae4102d50 0x7f9ae41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/3626606904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae4101b60 0x7f9ae4101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 -- 172.21.15.73:0/3626606904 >> 172.21.15.73:0/3626606904 conn(0x7f9ae40fd2e0 msgr2=0x7f9ae40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 -- 172.21.15.73:0/3626606904 shutdown_connections 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 -- 172.21.15.73:0/3626606904 wait complete. 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.820+0000 7f9aebfb9640 1 Processor -- start 2024-09-10T07:49:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aebfb9640 1 -- start start 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aebfb9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae4101b60 0x7f9ae4197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aebfb9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ae4102d50 0x7f9ae4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aebfb9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 0x7f9ae419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aebfb9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae410d8e0 con 0x7f9ae4103710 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aebfb9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae410d760 con 0x7f9ae4102d50 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aebfb9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae410da60 con 0x7f9ae4101b60 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aea556640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 0x7f9ae419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aea556640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 0x7f9ae419f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49986/0 (socket says 172.21.15.73:49986) 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aea556640 1 -- 172.21.15.73:0/320470384 learned_addr learned my addr 172.21.15.73:0/320470384 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9ae9554640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ae4102d50 0x7f9ae4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9ae9d55640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae4101b60 0x7f9ae4197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aea556640 1 -- 172.21.15.73:0/320470384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae4101b60 msgr2=0x7f9ae4197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aea556640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae4101b60 0x7f9ae4197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aea556640 1 -- 172.21.15.73:0/320470384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ae4102d50 msgr2=0x7f9ae4198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aea556640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ae4102d50 0x7f9ae4198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aea556640 1 -- 172.21.15.73:0/320470384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae419faf0 con 0x7f9ae4103710 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9ae9554640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ae4102d50 0x7f9ae4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aea556640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 0x7f9ae419f480 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0098d0 tx=0x7f9adc02f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9ad6ffd640 1 -- 172.21.15.73:0/320470384 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc02fc30 con 0x7f9ae4103710 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9ad6ffd640 1 -- 172.21.15.73:0/320470384 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9adc003e50 con 0x7f9ae4103710 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae419fd80 con 0x7f9ae4103710 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.821+0000 7f9ad6ffd640 1 -- 172.21.15.73:0/320470384 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0305c0 con 0x7f9ae4103710 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.822+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae41a0320 con 0x7f9ae4103710 2024-09-10T07:49:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.822+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae4108f00 con 0x7f9ae4103710 2024-09-10T07:49:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.824+0000 7f9ad6ffd640 1 -- 172.21.15.73:0/320470384 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9adc004b40 con 0x7f9ae4103710 2024-09-10T07:49:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.824+0000 7f9ad6ffd640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f9ad00a2d50 0x7f9ad00a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.824+0000 7f9ae9d55640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f9ad00a2d50 0x7f9ad00a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.824+0000 7f9ad6ffd640 1 -- 172.21.15.73:0/320470384 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f9adc0f0690 con 0x7f9ae4103710 2024-09-10T07:49:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.825+0000 7f9ae9d55640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f9ad00a2d50 0x7f9ad00a5210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4102bb0 tx=0x7f9ad8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:01.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:01.827+0000 7f9ad6ffd640 1 -- 172.21.15.73:0/320470384 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9adc0433d0 con 0x7f9ae4103710 2024-09-10T07:49:01.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:01 smithi073 ceph-mon[30850]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.039+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f9ae402da10 con 0x7f9ae4103710 2024-09-10T07:49:02.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:01 smithi102 ceph-mon[35514]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:02.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:01 smithi159 ceph-mon[35522]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.792+0000 7f9ad6ffd640 1 -- 172.21.15.73:0/320470384 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f9adc0bd540 con 0x7f9ae4103710 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f9ad00a2d50 msgr2=0x7f9ad00a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f9ad00a2d50 0x7f9ad00a5210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4102bb0 tx=0x7f9ad8008040 comp rx=0 tx=0).stop 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 msgr2=0x7f9ae419f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 0x7f9ae419f480 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0098d0 tx=0x7f9adc02f840 comp rx=0 tx=0).stop 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 shutdown_connections 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f9ad00a2d50 0x7f9ad00a5210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ae4103710 0x7f9ae419f480 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ae4102d50 0x7f9ae4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 --2- 172.21.15.73:0/320470384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae4101b60 0x7f9ae4197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 >> 172.21.15.73:0/320470384 conn(0x7f9ae40fd2e0 msgr2=0x7f9ae41060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 shutdown_connections 2024-09-10T07:49:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:02.794+0000 7f9aebfb9640 1 -- 172.21.15.73:0/320470384 wait complete. 2024-09-10T07:49:02.810 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T07:49:02.835 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T07:49:02.836 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T07:49:02.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:49:02.836 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-10T07:49:02.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:49:02.853 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-09-10T07:49:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-09-10T07:49:02.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:49:02.923 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-10T07:49:02.924 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T07:49:02.924 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:49:02.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T07:49:03.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:02 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/320470384' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T07:49:03.126 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: ignoring --setuser ceph since I am not root 2024-09-10T07:49:03.126 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: ignoring --setgroup ceph since I am not root 2024-09-10T07:49:03.126 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:02 smithi102 ceph-mgr[36889]: -- 172.21.15.102:0/763161766 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604662150e0 con 0x5604661f3400 2024-09-10T07:49:03.126 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:02.946+0000 7f57d6a79040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:49:03.126 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:03.002+0000 7f57d6a79040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:49:03.150 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:02 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/320470384' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T07:49:03.150 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: ignoring --setuser ceph since I am not root 2024-09-10T07:49:03.150 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: ignoring --setgroup ceph since I am not root 2024-09-10T07:49:03.151 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:02 smithi159 ceph-mgr[37324]: -- 172.21.15.159:0/1378062024 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560110b850e0 con 0x560110b63000 2024-09-10T07:49:03.151 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:02.946+0000 7f85f405b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:49:03.151 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:03.003+0000 7f85f405b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:49:03.151 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:03.151+0000 7f85f405b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:49:03.162 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:02 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/320470384' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T07:49:03.163 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: ignoring --setuser ceph since I am not root 2024-09-10T07:49:03.163 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: ignoring --setgroup ceph since I am not root 2024-09-10T07:49:03.163 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:02.947+0000 7f3bf30ec040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:49:03.163 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:03.007+0000 7f3bf30ec040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:49:03.163 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:03.163+0000 7f3bf30ec040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:49:03.219 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:49:03.407 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:03.216+0000 7f85f405b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:49:03.407 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:03.364+0000 7f85f405b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:49:03.472 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:03.237+0000 7f3bf30ec040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:49:03.472 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:03.389+0000 7f3bf30ec040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:49:03.503 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:03.150+0000 7f57d6a79040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:49:03.504 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:03.216+0000 7f57d6a79040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:49:03.504 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:03.363+0000 7f57d6a79040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:49:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 -- 172.21.15.73:0/2427915141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100aa0 msgr2=0x7f2a8c10ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 --2- 172.21.15.73:0/2427915141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100aa0 0x7f2a8c10ea20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009ca0 tx=0x7f2a8402a8c0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 -- 172.21.15.73:0/2427915141 shutdown_connections 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 --2- 172.21.15.73:0/2427915141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100aa0 0x7f2a8c10ea20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 --2- 172.21.15.73:0/2427915141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c100100 0x7f2a8c100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 --2- 172.21.15.73:0/2427915141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a8c106b80 0x7f2a8c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 -- 172.21.15.73:0/2427915141 >> 172.21.15.73:0/2427915141 conn(0x7f2a8c077230 msgr2=0x7f2a8c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 -- 172.21.15.73:0/2427915141 shutdown_connections 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 -- 172.21.15.73:0/2427915141 wait complete. 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 Processor -- start 2024-09-10T07:49:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.717+0000 7f2a92939640 1 -- start start 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a92939640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100100 0x7f2a8c1012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a92939640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c100aa0 0x7f2a8c101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a92939640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a8c106b80 0x7f2a8c101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a92939640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c112050 con 0x7f2a8c100100 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a92939640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c111ed0 con 0x7f2a8c100aa0 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a92939640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c1121d0 con 0x7f2a8c106b80 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100100 0x7f2a8c1012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100100 0x7f2a8c1012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50032/0 (socket says 172.21.15.73:50032) 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8bfff640 1 -- 172.21.15.73:0/1715903909 learned_addr learned my addr 172.21.15.73:0/1715903909 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8b7fe640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c100aa0 0x7f2a8c101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a90ed6640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a8c106b80 0x7f2a8c101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8bfff640 1 -- 172.21.15.73:0/1715903909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a8c106b80 msgr2=0x7f2a8c101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8bfff640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a8c106b80 0x7f2a8c101d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8bfff640 1 -- 172.21.15.73:0/1715903909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c100aa0 msgr2=0x7f2a8c101820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8bfff640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c100aa0 0x7f2a8c101820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8bfff640 1 -- 172.21.15.73:0/1715903909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c1a6930 con 0x7f2a8c100100 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a90ed6640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a8c106b80 0x7f2a8c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.718+0000 7f2a8bfff640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100100 0x7f2a8c1012e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00d950 tx=0x7f2a7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.719+0000 7f2a897fa640 1 -- 172.21.15.73:0/1715903909 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c017070 con 0x7f2a8c100100 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.719+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8c1a6c20 con 0x7f2a8c100100 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.719+0000 7f2a897fa640 1 -- 172.21.15.73:0/1715903909 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a7c009c30 con 0x7f2a8c100100 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.719+0000 7f2a897fa640 1 -- 172.21.15.73:0/1715903909 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00f6b0 con 0x7f2a8c100100 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.719+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a8c1a7160 con 0x7f2a8c100100 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.720+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a8c100560 con 0x7f2a8c100100 2024-09-10T07:49:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.721+0000 7f2a897fa640 1 -- 172.21.15.73:0/1715903909 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 137901+0+0 (secure 0 0 0) 0x7f2a7c0109d0 con 0x7f2a8c100100 2024-09-10T07:49:03.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.722+0000 7f2a897fa640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2a780a2c60 0x7f2a780a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:03.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.722+0000 7f2a8b7fe640 1 -- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2a780a2c60 msgr2=0x7f2a780a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/662943870 2024-09-10T07:49:03.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.722+0000 7f2a897fa640 1 -- 172.21.15.73:0/1715903909 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8327+0+0 (secure 0 0 0) 0x7f2a7c0cee40 con 0x7f2a8c100100 2024-09-10T07:49:03.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.722+0000 7f2a8b7fe640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2a780a2c60 0x7f2a780a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:49:03.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.725+0000 7f2a897fa640 1 -- 172.21.15.73:0/1715903909 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a7c009de0 con 0x7f2a8c100100 2024-09-10T07:49:03.739 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:03.535+0000 7f3bf30ec040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:49:03.793 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:03.504+0000 7f57d6a79040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:49:03.793 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:03.506+0000 7f85f405b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:49:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.923+0000 7f2a8b7fe640 1 -- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2a780a2c60 msgr2=0x7f2a780a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/662943870 2024-09-10T07:49:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.923+0000 7f2a8b7fe640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2a780a2c60 0x7f2a780a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:49:03.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.932+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2a8c10a010 con 0x7f2a8c100100 2024-09-10T07:49:03.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.932+0000 7f2a897fa640 1 -- 172.21.15.73:0/1715903909 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+73 (secure 0 0 0) 0x7f2a7c09bbe0 con 0x7f2a8c100100 2024-09-10T07:49:03.932 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:49:03.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.934+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2a780a2c60 msgr2=0x7f2a780a5120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:49:03.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.934+0000 7f2a92939640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2a780a2c60 0x7f2a780a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.934+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100100 msgr2=0x7f2a8c1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:03.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.934+0000 7f2a92939640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100100 0x7f2a8c1012e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00d950 tx=0x7f2a7c00de10 comp rx=0 tx=0).stop 2024-09-10T07:49:03.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.934+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 shutdown_connections 2024-09-10T07:49:03.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.934+0000 7f2a92939640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:6800/662943870,v1:172.21.15.73:6801/662943870] conn(0x7f2a780a2c60 0x7f2a780a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.935+0000 7f2a92939640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a8c106b80 0x7f2a8c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.935+0000 7f2a92939640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c100aa0 0x7f2a8c101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.935+0000 7f2a92939640 1 --2- 172.21.15.73:0/1715903909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a8c100100 0x7f2a8c1012e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:03.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.935+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 >> 172.21.15.73:0/1715903909 conn(0x7f2a8c077230 msgr2=0x7f2a8c0fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:03.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.935+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 shutdown_connections 2024-09-10T07:49:03.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:03.935+0000 7f2a92939640 1 -- 172.21.15.73:0/1715903909 wait complete. 2024-09-10T07:49:04.062 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:03 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/320470384' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T07:49:04.062 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:03 smithi102 ceph-mon[35514]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T07:49:04.062 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:03.819+0000 7f57d6a79040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:49:04.062 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:03.879+0000 7f57d6a79040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:49:04.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:03 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/320470384' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T07:49:04.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:03 smithi159 ceph-mon[35522]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T07:49:04.066 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:03.821+0000 7f85f405b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:49:04.066 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:03.882+0000 7f85f405b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:49:04.066 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:04.066+0000 7f85f405b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:49:04.106 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:03 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/320470384' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T07:49:04.106 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:03 smithi073 ceph-mon[30850]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T07:49:04.106 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:03.855+0000 7f3bf30ec040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:49:04.106 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:03.917+0000 7f3bf30ec040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:49:04.106 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:04.106+0000 7f3bf30ec040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:49:04.375 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:04.062+0000 7f57d6a79040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:49:04.569 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T07:49:04.569 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:49:04.569 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-10T07:49:04.569 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:49:04.570 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:49:04.570 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T07:49:04.570 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T07:49:04.570 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:49:04.570 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:49:04.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:49:04.570 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-10T07:49:04.586 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:49:04.586 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:49:04.587 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-10T07:49:04.588 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:49:04.588 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42240sec preferred_lft 42240sec 2024-09-10T07:49:04.588 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link noprefixroute 2024-09-10T07:49:04.588 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:49:04.588 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T07:49:04.588 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:49:04.588 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T07:49:04.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-09-10T07:49:04.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-09-10T07:49:04.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-09-10T07:49:04.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T07:49:04.589 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T07:49:04.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:49:04.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:49:04.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:49:04.802 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:49:04.827 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-10T07:49:04.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:49:04.829 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-10T07:49:04.897 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-10T07:49:04.898 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:49:04.898 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:49:04.898 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:49:04.898 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:49:04.898 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:49:04.898 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T07:49:04.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:49:04.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:49:04.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:49:04.899 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T07:49:04.947 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:04 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1715903909' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T07:49:04.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:04 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1715903909' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T07:49:04.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:49:05.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:04 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1715903909' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T07:49:05.157 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:04.952+0000 7f85f405b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:49:05.157 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:05.020+0000 7f85f405b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:49:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:49:05.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:49:05.189 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-10T07:49:05.213 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:04.948+0000 7f57d6a79040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:49:05.213 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:05.015+0000 7f57d6a79040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:49:05.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:49:05.246 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-09-10T07:49:05.301 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:49:05.301 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T07:49:05.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:49:05.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T07:49:05.301 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T07:49:05.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:49:05.399 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:05.025+0000 7f3bf30ec040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:49:05.399 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:05.097+0000 7f3bf30ec040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:49:05.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:49:05.421 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T07:49:05.421 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:49:05.421 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T07:49:05.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T07:49:05.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T07:49:05.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T07:49:05.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T07:49:05.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T07:49:05.422 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T07:49:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:49:05.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:49:05.550 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:49:05.551 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-10T07:49:05.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-10T07:49:05.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T07:49:05.551 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-10T07:49:05.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:49:05.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:49:05.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:49:05.629 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:49:05.644 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:49:05.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:49:05.644 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:49:05.700 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T07:49:05.700 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T07:49:05.700 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/281d3ef3-71e1-446c-a012-5b93ad7133e6 2024-09-10T07:49:05.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:49:05.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/281d3ef3-71e1-446c-a012-5b93ad7133e6 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-09-10T07:49:05.819 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-09-10T07:49:05.819 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync". 2024-09-10T07:49:05.953 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-09-10T07:49:05.954 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync". 2024-09-10T07:49:05.954 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.102:3300,172.21.15.159:3300" 2024-09-10T07:49:05.954 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: 0@c025e280-6f47-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/281d3ef3-71e1-446c-a012-5b93ad7133e6 2024-09-10T07:49:05.954 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync,name=0,key=0,mon_addr=172.21.15.73:3300/172.21.15.102:3300/172.21.15.159:3300" will pass to kernel 2024-09-10T07:49:05.955 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:49:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:49:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:49:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:49:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:49:05.956 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:49:05.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:49:05.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:49:05.990 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:05.730+0000 7f57d6a79040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:49:05.991 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:05.845+0000 7f57d6a79040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:49:05.991 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:05.731+0000 7f85f405b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:49:05.991 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:05.847+0000 7f85f405b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:49:06.134 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:05.855+0000 7f3bf30ec040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:49:06.135 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:05.991+0000 7f3bf30ec040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:49:06.268 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:05.991+0000 7f57d6a79040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:49:06.268 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.052+0000 7f57d6a79040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:49:06.268 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.200+0000 7f57d6a79040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:49:06.269 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:05.991+0000 7f85f405b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:49:06.270 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.053+0000 7f85f405b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:49:06.270 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.202+0000 7f85f405b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:49:06.270 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.270+0000 7f85f405b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:49:06.413 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.135+0000 7f3bf30ec040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:49:06.413 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.196+0000 7f3bf30ec040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:49:06.413 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.346+0000 7f3bf30ec040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:49:06.413 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.413+0000 7f3bf30ec040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:49:06.551 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.269+0000 7f57d6a79040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:49:06.551 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.329+0000 7f57d6a79040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:49:06.551 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.488+0000 7f57d6a79040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:49:06.556 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.330+0000 7f85f405b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:49:06.556 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.491+0000 7f85f405b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:49:06.556 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.556+0000 7f85f405b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:49:06.694 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.474+0000 7f3bf30ec040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:49:06.694 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.630+0000 7f3bf30ec040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:49:06.694 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.694+0000 7f3bf30ec040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:49:06.816 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.552+0000 7f57d6a79040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:49:06.816 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.617+0000 7f57d6a79040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:49:06.816 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.699+0000 7f57d6a79040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:49:06.816 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.758+0000 7f57d6a79040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:49:06.816 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:06.816+0000 7f57d6a79040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:49:06.823 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.623+0000 7f85f405b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:49:06.823 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.705+0000 7f85f405b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:49:06.823 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.764+0000 7f85f405b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:49:06.823 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:06.823+0000 7f85f405b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:49:06.960 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.760+0000 7f3bf30ec040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:49:06.960 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.843+0000 7f3bf30ec040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:49:06.960 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.902+0000 7f3bf30ec040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:49:06.960 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:06.960+0000 7f3bf30ec040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:49:07.782 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:49:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:49:07.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:49:07.869 INFO:teuthology.orchestra.run.smithi073.stdout:client15075 2024-09-10T07:49:07.870 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:49:07.870 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:49:07.875 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y[36885]: 2024-09-10T07:49:07.602+0000 7f57d6a79040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: Standby manager daemon y restarted 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: Standby manager daemon y started 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: Standby manager daemon z restarted 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: Standby manager daemon z started 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:49:07.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T07:49:07.877 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:07 smithi102 ceph-mon[35514]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:49:07.889 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:49:07.907 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z[37320]: 2024-09-10T07:49:07.611+0000 7f85f405b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:49:07.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: Standby manager daemon y restarted 2024-09-10T07:49:07.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: Standby manager daemon y started 2024-09-10T07:49:07.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T07:49:07.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:49:07.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T07:49:07.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:49:07.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: Standby manager daemon z restarted 2024-09-10T07:49:07.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: Standby manager daemon z started 2024-09-10T07:49:07.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T07:49:07.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:49:07.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T07:49:07.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:07 smithi159 ceph-mon[35522]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:49:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: Standby manager daemon y restarted 2024-09-10T07:49:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: Standby manager daemon y started 2024-09-10T07:49:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T07:49:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:49:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T07:49:07.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.102:0/1184828194' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:49:07.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: Standby manager daemon z restarted 2024-09-10T07:49:07.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: Standby manager daemon z started 2024-09-10T07:49:07.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T07:49:07.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T07:49:07.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T07:49:07.973 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-mon[30850]: from='mgr.? 172.21.15.159:0/2968775124' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T07:49:07.973 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:07.753+0000 7f3bf30ec040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:49:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:49:08.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:49:08.015 INFO:teuthology.orchestra.run.smithi073.stdout:client15075 2024-09-10T07:49:08.015 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:49:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:49:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:49:08.116 INFO:teuthology.orchestra.run.smithi073.stdout:client15075 2024-09-10T07:49:08.117 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c025e280-6f47-11ef-bcea-c7b262605968.client15075/status') 2024-09-10T07:49:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:49:08.177 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.15075 (3)192.168.0.1:0/2896314919 2024-09-10T07:49:08.177 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2024-09-10T07:49:08.177 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2024-09-10T07:49:08.178 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2024-09-10T07:49:08.178 INFO:teuthology.orchestra.run.smithi073.stderr:70 bytes copied, 2.4959e-05 s, 2.8 MB/s 2024-09-10T07:49:08.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:49:08.185 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T07:49:08.197 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T07:49:08.205 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T07:49:08.205 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T07:49:08.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-10T07:49:08.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.309+0000 7f16a0ae6640 1 -- 172.21.15.73:0/2079518901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 msgr2=0x7f169c108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.309+0000 7f16a0ae6640 1 --2- 172.21.15.73:0/2079518901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 0x7f169c108e80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1694009ca0 tx=0x7f169402a8c0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.309+0000 7f16a0ae6640 1 -- 172.21.15.73:0/2079518901 shutdown_connections 2024-09-10T07:49:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.309+0000 7f16a0ae6640 1 --2- 172.21.15.73:0/2079518901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 0x7f169c108e80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.309+0000 7f16a0ae6640 1 --2- 172.21.15.73:0/2079518901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c101c30 0x7f169c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.309+0000 7f16a0ae6640 1 --2- 172.21.15.73:0/2079518901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f169c100a40 0x7f169c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.309+0000 7f16a0ae6640 1 -- 172.21.15.73:0/2079518901 >> 172.21.15.73:0/2079518901 conn(0x7f169c0fc1e0 msgr2=0x7f169c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.309+0000 7f16a0ae6640 1 -- 172.21.15.73:0/2079518901 shutdown_connections 2024-09-10T07:49:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.309+0000 7f16a0ae6640 1 -- 172.21.15.73:0/2079518901 wait complete. 2024-09-10T07:49:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f16a0ae6640 1 Processor -- start 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f16a0ae6640 1 -- start start 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f16a0ae6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c100a40 0x7f169c06a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f16a0ae6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f169c101c30 0x7f169c19cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f16a0ae6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 0x7f169c19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f16a0ae6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f169c10c6c0 con 0x7f169c1025f0 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f16a0ae6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f169c10c540 con 0x7f169c101c30 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f16a0ae6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f169c10c840 con 0x7f169c100a40 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f169ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 0x7f169c19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f169ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 0x7f169c19f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50178/0 (socket says 172.21.15.73:50178) 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f169ad9d640 1 -- 172.21.15.73:0/1861195250 learned_addr learned my addr 172.21.15.73:0/1861195250 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f169a59c640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c100a40 0x7f169c06a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f1699d9b640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f169c101c30 0x7f169c19cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f169ad9d640 1 -- 172.21.15.73:0/1861195250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c100a40 msgr2=0x7f169c06a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f169ad9d640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c100a40 0x7f169c06a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f169ad9d640 1 -- 172.21.15.73:0/1861195250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f169c101c30 msgr2=0x7f169c19cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f169ad9d640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f169c101c30 0x7f169c19cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f169ad9d640 1 -- 172.21.15.73:0/1861195250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c19fa00 con 0x7f169c1025f0 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.310+0000 7f1699d9b640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f169c101c30 0x7f169c19cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.311+0000 7f169ad9d640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 0x7f169c19f0f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1694031ae0 tx=0x7f1694031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.311+0000 7f168b7fe640 1 -- 172.21.15.73:0/1861195250 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694003b70 con 0x7f169c1025f0 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.311+0000 7f168b7fe640 1 -- 172.21.15.73:0/1861195250 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1694003d10 con 0x7f169c1025f0 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.311+0000 7f16a0ae6640 1 -- 172.21.15.73:0/1861195250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169c19fc30 con 0x7f169c1025f0 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.311+0000 7f168b7fe640 1 -- 172.21.15.73:0/1861195250 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169402fc40 con 0x7f169c1025f0 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.311+0000 7f16a0ae6640 1 -- 172.21.15.73:0/1861195250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169c1a0180 con 0x7f169c1025f0 2024-09-10T07:49:08.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.312+0000 7f16a0ae6640 1 -- 172.21.15.73:0/1861195250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169c107de0 con 0x7f169c1025f0 2024-09-10T07:49:08.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.313+0000 7f168b7fe640 1 -- 172.21.15.73:0/1861195250 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7f1694004050 con 0x7f169c1025f0 2024-09-10T07:49:08.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.314+0000 7f168b7fe640 1 -- 172.21.15.73:0/1861195250 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8628+0+0 (secure 0 0 0) 0x7f16940efed0 con 0x7f169c1025f0 2024-09-10T07:49:08.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.320+0000 7f168b7fe640 1 -- 172.21.15.73:0/1861195250 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16940bd0a0 con 0x7f169c1025f0 2024-09-10T07:49:08.340 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5cf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.340 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5cf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.340 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5cf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.340 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5cf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.340 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5cf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.340 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5a6fe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.340 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5a6fe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.340 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5a6fe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.340 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5a6fe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.341 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:08.066+0000 7f3b5a6fe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:49:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.499+0000 7f16a0ae6640 1 -- 172.21.15.73:0/1861195250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f169c062f00 con 0x7f169c1025f0 2024-09-10T07:49:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.503+0000 7f168b7fe640 1 -- 172.21.15.73:0/1861195250 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v27)=0 v27) ==== 129+0+0 (secure 0 0 0) 0x7f16940bc9a0 con 0x7f169c1025f0 2024-09-10T07:49:08.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.506+0000 7f16a0ae6640 1 -- 172.21.15.73:0/1861195250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 msgr2=0x7f169c19f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.506+0000 7f16a0ae6640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 0x7f169c19f0f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1694031ae0 tx=0x7f1694031ee0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.506+0000 7f16a0ae6640 1 -- 172.21.15.73:0/1861195250 shutdown_connections 2024-09-10T07:49:08.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.506+0000 7f16a0ae6640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169c1025f0 0x7f169c19f0f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.506+0000 7f16a0ae6640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f169c101c30 0x7f169c19cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.506+0000 7f16a0ae6640 1 --2- 172.21.15.73:0/1861195250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c100a40 0x7f169c06a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.506+0000 7f16a0ae6640 1 -- 172.21.15.73:0/1861195250 >> 172.21.15.73:0/1861195250 conn(0x7f169c0fc1e0 msgr2=0x7f169c104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.506+0000 7f16a0ae6640 1 -- 172.21.15.73:0/1861195250 shutdown_connections 2024-09-10T07:49:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.506+0000 7f16a0ae6640 1 -- 172.21.15.73:0/1861195250 wait complete. 2024-09-10T07:49:08.518 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-10T07:49:08.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 -- 172.21.15.73:0/4115634943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 msgr2=0x7f8ee41049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 --2- 172.21.15.73:0/4115634943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 0x7f8ee41049b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009900 tx=0x7f8ed402a410 comp rx=0 tx=0).stop 2024-09-10T07:49:08.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 -- 172.21.15.73:0/4115634943 shutdown_connections 2024-09-10T07:49:08.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 --2- 172.21.15.73:0/4115634943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ee4107820 0x7f8ee4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 --2- 172.21.15.73:0/4115634943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee4104ef0 0x7f8ee41072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 --2- 172.21.15.73:0/4115634943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 0x7f8ee41049b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 -- 172.21.15.73:0/4115634943 >> 172.21.15.73:0/4115634943 conn(0x7f8ee40fc1e0 msgr2=0x7f8ee40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 -- 172.21.15.73:0/4115634943 shutdown_connections 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 -- 172.21.15.73:0/4115634943 wait complete. 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 Processor -- start 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.622+0000 7f8eea265640 1 -- start start 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8eea265640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 0x7f8ee4101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8eea265640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ee4104ef0 0x7f8ee4100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8eea265640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee4107820 0x7f8ee4100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8eea265640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee410d820 con 0x7f8ee41025c0 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8eea265640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee410d6a0 con 0x7f8ee4104ef0 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8eea265640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee410d9a0 con 0x7f8ee4107820 2024-09-10T07:49:08.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 0x7f8ee4101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 0x7f8ee4101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50198/0 (socket says 172.21.15.73:50198) 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee3fff640 1 -- 172.21.15.73:0/1832694676 learned_addr learned my addr 172.21.15.73:0/1832694676 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee37fe640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ee4104ef0 0x7f8ee4100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee8802640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee4107820 0x7f8ee4100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee3fff640 1 -- 172.21.15.73:0/1832694676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee4107820 msgr2=0x7f8ee4100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee3fff640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee4107820 0x7f8ee4100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee3fff640 1 -- 172.21.15.73:0/1832694676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ee4104ef0 msgr2=0x7f8ee4100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee3fff640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ee4104ef0 0x7f8ee4100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee3fff640 1 -- 172.21.15.73:0/1832694676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee4101340 con 0x7f8ee41025c0 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee3fff640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 0x7f8ee4101f30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009230 tx=0x7f8ed4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.623+0000 7f8ee17fa640 1 -- 172.21.15.73:0/1832694676 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed403f030 con 0x7f8ee41025c0 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.624+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee41a1f60 con 0x7f8ee41025c0 2024-09-10T07:49:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.624+0000 7f8ee17fa640 1 -- 172.21.15.73:0/1832694676 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed4003ce0 con 0x7f8ee41025c0 2024-09-10T07:49:08.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.624+0000 7f8ee17fa640 1 -- 172.21.15.73:0/1832694676 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4035070 con 0x7f8ee41025c0 2024-09-10T07:49:08.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.624+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee41a2370 con 0x7f8ee41025c0 2024-09-10T07:49:08.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.625+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee40fdcd0 con 0x7f8ee41025c0 2024-09-10T07:49:08.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.626+0000 7f8ee17fa640 1 -- 172.21.15.73:0/1832694676 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7f8ed4042030 con 0x7f8ee41025c0 2024-09-10T07:49:08.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.627+0000 7f8ee17fa640 1 -- 172.21.15.73:0/1832694676 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8628+0+0 (secure 0 0 0) 0x7f8ed40ef4c0 con 0x7f8ee41025c0 2024-09-10T07:49:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.634+0000 7f8ee17fa640 1 -- 172.21.15.73:0/1832694676 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ed40bc040 con 0x7f8ee41025c0 2024-09-10T07:49:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.776+0000 7f8ee17fa640 1 -- 172.21.15.73:0/1832694676 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f8ed40b7d90 con 0x7f8ee41025c0 2024-09-10T07:49:08.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.777+0000 7f8ee17fa640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f8ecc0a9b80 0x7f8ecc0abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.781+0000 7f8ee37fe640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f8ecc0a9b80 0x7f8ecc0abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.783+0000 7f8ee37fe640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f8ecc0a9b80 0x7f8ecc0abf70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4101ca0 tx=0x7f8ed800b390 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.845+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f8ee402d7c0 con 0x7f8ee41025c0 2024-09-10T07:49:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.849+0000 7f8ee17fa640 1 -- 172.21.15.73:0/1832694676 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7f8ed407df40 con 0x7f8ee41025c0 2024-09-10T07:49:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.851+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f8ecc0a9b80 msgr2=0x7f8ecc0abf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.851+0000 7f8eea265640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f8ecc0a9b80 0x7f8ecc0abf70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4101ca0 tx=0x7f8ed800b390 comp rx=0 tx=0).stop 2024-09-10T07:49:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.851+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 msgr2=0x7f8ee4101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.851+0000 7f8eea265640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 0x7f8ee4101f30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009230 tx=0x7f8ed4004360 comp rx=0 tx=0).stop 2024-09-10T07:49:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.852+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 shutdown_connections 2024-09-10T07:49:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.852+0000 7f8eea265640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f8ecc0a9b80 0x7f8ecc0abf70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.852+0000 7f8eea265640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee4107820 0x7f8ee4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.852+0000 7f8eea265640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ee4104ef0 0x7f8ee4100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.852+0000 7f8eea265640 1 --2- 172.21.15.73:0/1832694676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee41025c0 0x7f8ee4101f30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.852+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 >> 172.21.15.73:0/1832694676 conn(0x7f8ee40fc1e0 msgr2=0x7f8ee4102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.852+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 shutdown_connections 2024-09-10T07:49:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.852+0000 7f8eea265640 1 -- 172.21.15.73:0/1832694676 wait complete. 2024-09-10T07:49:08.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-10T07:49:08.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T07:49:08.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: Active manager daemon x restarted 2024-09-10T07:49:08.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: Activating manager daemon x 2024-09-10T07:49:08.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T07:49:08.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: mgrmap e20: x(active, starting, since 0.0119904s), standbys: z, y 2024-09-10T07:49:08.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:49:08.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:49:08.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:49:08.963 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T07:49:08.964 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T07:49:08.965 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T07:49:08.966 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: Manager daemon x is now available 2024-09-10T07:49:08.966 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:49:08.966 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T07:49:08.966 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T07:49:08.966 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:08 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1861195250' entity='client.admin' 2024-09-10T07:49:08.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.964+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/209938350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b841025f0 msgr2=0x7f3b84108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.964+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/209938350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b841025f0 0x7f3b84108e80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009ca0 tx=0x7f3b7c02a8c0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.964+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/209938350 shutdown_connections 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.964+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/209938350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b841025f0 0x7f3b84108e80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.964+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/209938350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b84101c30 0x7f3b841020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.964+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/209938350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b84100a40 0x7f3b84100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.964+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/209938350 >> 172.21.15.73:0/209938350 conn(0x7f3b840fc1e0 msgr2=0x7f3b840fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.964+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/209938350 shutdown_connections 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.964+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/209938350 wait complete. 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8c5fd640 1 Processor -- start 2024-09-10T07:49:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8c5fd640 1 -- start start 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8c5fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b84100a40 0x7f3b84197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8c5fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b84101c30 0x7f3b841982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8c5fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b841025f0 0x7f3b8419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8c5fd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8410d810 con 0x7f3b84101c30 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8c5fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8410d690 con 0x7f3b841025f0 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8c5fd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8410d990 con 0x7f3b84100a40 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b89b98640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b84101c30 0x7f3b841982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b89b98640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b84101c30 0x7f3b841982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50206/0 (socket says 172.21.15.73:50206) 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b89b98640 1 -- 172.21.15.73:0/30857502 learned_addr learned my addr 172.21.15.73:0/30857502 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8a399640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b84100a40 0x7f3b84197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b8ab9a640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b841025f0 0x7f3b8419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b89b98640 1 -- 172.21.15.73:0/30857502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b84100a40 msgr2=0x7f3b84197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b89b98640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b84100a40 0x7f3b84197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b89b98640 1 -- 172.21.15.73:0/30857502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b841025f0 msgr2=0x7f3b8419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b89b98640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b841025f0 0x7f3b8419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b89b98640 1 -- 172.21.15.73:0/30857502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8419f9c0 con 0x7f3b84101c30 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.965+0000 7f3b89b98640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b84101c30 0x7f3b841982f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400e9f0 tx=0x7f3b7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.966+0000 7f3b7b7fe640 1 -- 172.21.15.73:0/30857502 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400cd80 con 0x7f3b84101c30 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.966+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8419fcb0 con 0x7f3b84101c30 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.966+0000 7f3b7b7fe640 1 -- 172.21.15.73:0/30857502 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b74010910 con 0x7f3b84101c30 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.966+0000 7f3b7b7fe640 1 -- 172.21.15.73:0/30857502 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b740188f0 con 0x7f3b84101c30 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.966+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b841a01b0 con 0x7f3b84101c30 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.967+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b84107d60 con 0x7f3b84101c30 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.969+0000 7f3b7b7fe640 1 -- 172.21.15.73:0/30857502 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f3b74010ac0 con 0x7f3b84101c30 2024-09-10T07:49:08.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.970+0000 7f3b7b7fe640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f3b700a2a40 0x7f3b700a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:08.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T07:49:08.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: Active manager daemon x restarted 2024-09-10T07:49:08.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: Activating manager daemon x 2024-09-10T07:49:08.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T07:49:08.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: mgrmap e20: x(active, starting, since 0.0119904s), standbys: z, y 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T07:49:08.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:49:08.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: Manager daemon x is now available 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T07:49:08.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:08 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1861195250' entity='client.admin' 2024-09-10T07:49:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.970+0000 7f3b7b7fe640 1 -- 172.21.15.73:0/30857502 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8628+0+0 (secure 0 0 0) 0x7f3b740cf120 con 0x7f3b84101c30 2024-09-10T07:49:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.970+0000 7f3b8a399640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f3b700a2a40 0x7f3b700a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.970+0000 7f3b8a399640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f3b700a2a40 0x7f3b700a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b84199280 tx=0x7f3b80005f90 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: Active manager daemon x restarted 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: Activating manager daemon x 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: mgrmap e20: x(active, starting, since 0.0119904s), standbys: z, y 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T07:49:08.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T07:49:08.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: Manager daemon x is now available 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:49:08.978 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T07:49:08.979 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T07:49:08.979 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:08 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1861195250' entity='client.admin' 2024-09-10T07:49:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:08.975+0000 7f3b7b7fe640 1 -- 172.21.15.73:0/30857502 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b7409bc60 con 0x7f3b84101c30 2024-09-10T07:49:09.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.154+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f3b84062f00 con 0x7f3b84101c30 2024-09-10T07:49:09.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.157+0000 7f3b7b7fe640 1 -- 172.21.15.73:0/30857502 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) ==== 133+0+0 (secure 0 0 0) 0x7f3b74086020 con 0x7f3b84101c30 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f3b700a2a40 msgr2=0x7f3b700a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f3b700a2a40 0x7f3b700a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b84199280 tx=0x7f3b80005f90 comp rx=0 tx=0).stop 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b84101c30 msgr2=0x7f3b841982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b84101c30 0x7f3b841982f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400e9f0 tx=0x7f3b7400eeb0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 shutdown_connections 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f3b700a2a40 0x7f3b700a4f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b841025f0 0x7f3b8419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b84101c30 0x7f3b841982f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 --2- 172.21.15.73:0/30857502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b84100a40 0x7f3b84197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 >> 172.21.15.73:0/30857502 conn(0x7f3b840fc1e0 msgr2=0x7f3b84104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:09.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 shutdown_connections 2024-09-10T07:49:09.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.160+0000 7f3b8c5fd640 1 -- 172.21.15.73:0/30857502 wait complete. 2024-09-10T07:49:09.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-10T07:49:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.275+0000 7f4f220b7640 1 -- 172.21.15.73:0/1615214152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 msgr2=0x7f4f1c108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.275+0000 7f4f220b7640 1 --2- 172.21.15.73:0/1615214152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 0x7f4f1c108620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009ca0 tx=0x7f4f1402a8c0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.275+0000 7f4f220b7640 1 -- 172.21.15.73:0/1615214152 shutdown_connections 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.275+0000 7f4f220b7640 1 --2- 172.21.15.73:0/1615214152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 0x7f4f1c108620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.275+0000 7f4f220b7640 1 --2- 172.21.15.73:0/1615214152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f1c1013d0 0x7f4f1c101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.275+0000 7f4f220b7640 1 --2- 172.21.15.73:0/1615214152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c1001e0 0x7f4f1c1005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.275+0000 7f4f220b7640 1 -- 172.21.15.73:0/1615214152 >> 172.21.15.73:0/1615214152 conn(0x7f4f1c0fb980 msgr2=0x7f4f1c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.275+0000 7f4f220b7640 1 -- 172.21.15.73:0/1615214152 shutdown_connections 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.275+0000 7f4f220b7640 1 -- 172.21.15.73:0/1615214152 wait complete. 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f220b7640 1 Processor -- start 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f220b7640 1 -- start start 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f220b7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f1c1001e0 0x7f4f1c109b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f220b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c1013d0 0x7f4f1c19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f220b7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 0x7f4f1c19f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f220b7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c10c720 con 0x7f4f1c101d90 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f220b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c10c5a0 con 0x7f4f1c1013d0 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f220b7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c10c8a0 con 0x7f4f1c1001e0 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 0x7f4f1c19f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 0x7f4f1c19f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50212/0 (socket says 172.21.15.73:50212) 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1bfff640 1 -- 172.21.15.73:0/3106764858 learned_addr learned my addr 172.21.15.73:0/3106764858 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1affd640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c1013d0 0x7f4f1c19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1b7fe640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f1c1001e0 0x7f4f1c109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1bfff640 1 -- 172.21.15.73:0/3106764858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f1c1001e0 msgr2=0x7f4f1c109b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1bfff640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f1c1001e0 0x7f4f1c109b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1bfff640 1 -- 172.21.15.73:0/3106764858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c1013d0 msgr2=0x7f4f1c19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1bfff640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c1013d0 0x7f4f1c19ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.276+0000 7f4f1bfff640 1 -- 172.21.15.73:0/3106764858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1c19f960 con 0x7f4f1c101d90 2024-09-10T07:49:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.277+0000 7f4f1bfff640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 0x7f4f1c19f050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4f14005e30 tx=0x7f4f14031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.277+0000 7f4f18ff9640 1 -- 172.21.15.73:0/3106764858 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14003b70 con 0x7f4f1c101d90 2024-09-10T07:49:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.277+0000 7f4f18ff9640 1 -- 172.21.15.73:0/3106764858 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f14003d10 con 0x7f4f1c101d90 2024-09-10T07:49:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.277+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1c19fb90 con 0x7f4f1c101d90 2024-09-10T07:49:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.277+0000 7f4f18ff9640 1 -- 172.21.15.73:0/3106764858 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1402fd30 con 0x7f4f1c101d90 2024-09-10T07:49:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.277+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1c1a00e0 con 0x7f4f1c101d90 2024-09-10T07:49:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.278+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f1c107500 con 0x7f4f1c101d90 2024-09-10T07:49:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.279+0000 7f4f18ff9640 1 -- 172.21.15.73:0/3106764858 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f4f14004050 con 0x7f4f1c101d90 2024-09-10T07:49:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.280+0000 7f4f18ff9640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4f040a2a40 0x7f4f040a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.280+0000 7f4f1b7fe640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4f040a2a40 0x7f4f040a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.280+0000 7f4f18ff9640 1 -- 172.21.15.73:0/3106764858 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8628+0+0 (secure 0 0 0) 0x7f4f140f0040 con 0x7f4f1c101d90 2024-09-10T07:49:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.280+0000 7f4f1b7fe640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4f040a2a40 0x7f4f040a4f00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c005fd0 tx=0x7f4f0c005850 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.284+0000 7f4f18ff9640 1 -- 172.21.15.73:0/3106764858 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4f140bd220 con 0x7f4f1c101d90 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:09.220+0000 7f3b4110c640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:07:49:09] ENGINE Error in HTTPServer.serve 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: Traceback (most recent call last): 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self._connections.run(self.expiration_interval) 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self._run(expiration_interval) 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:49:09.473 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: s = self.context.wrap_socket( 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: return self.sslsocket_class._create( 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self.do_handshake() 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: self._sslobj.do_handshake() 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:49:09.474 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:49:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.497+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 --> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f4f1c062630 con 0x7f4f040a2a40 2024-09-10T07:49:09.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.558+0000 7f4f18ff9640 1 -- 172.21.15.73:0/3106764858 <== mgr.15066 v2:172.21.15.73:6800/3122839464 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4f1c062630 con 0x7f4f040a2a40 2024-09-10T07:49:09.558 INFO:teuthology.orchestra.run.smithi073.stdout:Schedule set for path / 2024-09-10T07:49:09.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4f040a2a40 msgr2=0x7f4f040a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4f040a2a40 0x7f4f040a4f00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c005fd0 tx=0x7f4f0c005850 comp rx=0 tx=0).stop 2024-09-10T07:49:09.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 msgr2=0x7f4f1c19f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 0x7f4f1c19f050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4f14005e30 tx=0x7f4f14031ee0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 shutdown_connections 2024-09-10T07:49:09.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4f040a2a40 0x7f4f040a4f00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f1c101d90 0x7f4f1c19f050 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c1013d0 0x7f4f1c19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 --2- 172.21.15.73:0/3106764858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f1c1001e0 0x7f4f1c109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 >> 172.21.15.73:0/3106764858 conn(0x7f4f1c0fb980 msgr2=0x7f4f1c1046d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:09.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 shutdown_connections 2024-09-10T07:49:09.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.561+0000 7f4f220b7640 1 -- 172.21.15.73:0/3106764858 wait complete. 2024-09-10T07:49:09.572 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-10T07:49:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.685+0000 7f59cf952640 1 -- 172.21.15.73:0/805476767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81025f0 msgr2=0x7f59c8108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.685+0000 7f59cf952640 1 --2- 172.21.15.73:0/805476767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81025f0 0x7f59c8108e80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009ca0 tx=0x7f59c002a8c0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.685+0000 7f59cf952640 1 -- 172.21.15.73:0/805476767 shutdown_connections 2024-09-10T07:49:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.685+0000 7f59cf952640 1 --2- 172.21.15.73:0/805476767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c81025f0 0x7f59c8108e80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.685+0000 7f59cf952640 1 --2- 172.21.15.73:0/805476767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c8101c30 0x7f59c81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.685+0000 7f59cf952640 1 --2- 172.21.15.73:0/805476767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8100a40 0x7f59c8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.685+0000 7f59cf952640 1 -- 172.21.15.73:0/805476767 >> 172.21.15.73:0/805476767 conn(0x7f59c80fc1e0 msgr2=0x7f59c80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.685+0000 7f59cf952640 1 -- 172.21.15.73:0/805476767 shutdown_connections 2024-09-10T07:49:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.685+0000 7f59cf952640 1 -- 172.21.15.73:0/805476767 wait complete. 2024-09-10T07:49:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.686+0000 7f59cf952640 1 Processor -- start 2024-09-10T07:49:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.686+0000 7f59cf952640 1 -- start start 2024-09-10T07:49:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.686+0000 7f59cf952640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c8100a40 0x7f59c8196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.686+0000 7f59cf952640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8101c30 0x7f59c8197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.686+0000 7f59cf952640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c81025f0 0x7f59c819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.686+0000 7f59cf952640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59c810c6a0 con 0x7f59c8100a40 2024-09-10T07:49:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.686+0000 7f59cf952640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59c810c520 con 0x7f59c81025f0 2024-09-10T07:49:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.686+0000 7f59cf952640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f59c810c820 con 0x7f59c8101c30 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.686+0000 7f59cd6ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c8100a40 0x7f59c8196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cd6ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c8100a40 0x7f59c8196c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50236/0 (socket says 172.21.15.73:50236) 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cd6ee640 1 -- 172.21.15.73:0/2682638309 learned_addr learned my addr 172.21.15.73:0/2682638309 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cceed640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8101c30 0x7f59c8197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cdeef640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c81025f0 0x7f59c819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cd6ee640 1 -- 172.21.15.73:0/2682638309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8101c30 msgr2=0x7f59c8197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cd6ee640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8101c30 0x7f59c8197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cd6ee640 1 -- 172.21.15.73:0/2682638309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c81025f0 msgr2=0x7f59c819e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cd6ee640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c81025f0 0x7f59c819e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cd6ee640 1 -- 172.21.15.73:0/2682638309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c819e860 con 0x7f59c8100a40 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cd6ee640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c8100a40 0x7f59c8196c50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f59c400d770 tx=0x7f59c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59be7fc640 1 -- 172.21.15.73:0/2682638309 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4017070 con 0x7f59c8100a40 2024-09-10T07:49:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59be7fc640 1 -- 172.21.15.73:0/2682638309 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59c4009c30 con 0x7f59c8100a40 2024-09-10T07:49:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59be7fc640 1 -- 172.21.15.73:0/2682638309 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4003dd0 con 0x7f59c8100a40 2024-09-10T07:49:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c819eb50 con 0x7f59c8100a40 2024-09-10T07:49:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.687+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c819f0a0 con 0x7f59c8100a40 2024-09-10T07:49:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.688+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c8107de0 con 0x7f59c8100a40 2024-09-10T07:49:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.689+0000 7f59be7fc640 1 -- 172.21.15.73:0/2682638309 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f59c4003fb0 con 0x7f59c8100a40 2024-09-10T07:49:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.690+0000 7f59be7fc640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f59b40a2ac0 0x7f59b40a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.690+0000 7f59cceed640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f59b40a2ac0 0x7f59b40a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.690+0000 7f59be7fc640 1 -- 172.21.15.73:0/2682638309 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8628+0+0 (secure 0 0 0) 0x7f59c40ce740 con 0x7f59c8100a40 2024-09-10T07:49:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.690+0000 7f59cceed640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f59b40a2ac0 0x7f59b40a4f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59b8005d00 tx=0x7f59b800b410 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.694+0000 7f59be7fc640 1 -- 172.21.15.73:0/2682638309 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f59c4009de0 con 0x7f59c8100a40 2024-09-10T07:49:09.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.934+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 --> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f59c80626d0 con 0x7f59b40a2ac0 2024-09-10T07:49:09.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-mon[30850]: mgrmap e21: x(active, since 1.02023s), standbys: z, y 2024-09-10T07:49:09.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-mon[30850]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:09.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1832694676' entity='client.admin' 2024-09-10T07:49:09.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:09 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/30857502' entity='client.admin' 2024-09-10T07:49:09.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.987+0000 7f59be7fc640 1 -- 172.21.15.73:0/2682638309 <== mgr.15066 v2:172.21.15.73:6800/3122839464 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f59c80626d0 con 0x7f59b40a2ac0 2024-09-10T07:49:09.986 INFO:teuthology.orchestra.run.smithi073.stdout:Retention added to path / 2024-09-10T07:49:09.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.988+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f59b40a2ac0 msgr2=0x7f59b40a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.988+0000 7f59cf952640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f59b40a2ac0 0x7f59b40a4f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59b8005d00 tx=0x7f59b800b410 comp rx=0 tx=0).stop 2024-09-10T07:49:09.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.988+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c8100a40 msgr2=0x7f59c8196c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:09.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.988+0000 7f59cf952640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c8100a40 0x7f59c8196c50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f59c400d770 tx=0x7f59c400dc30 comp rx=0 tx=0).stop 2024-09-10T07:49:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.989+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 shutdown_connections 2024-09-10T07:49:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.989+0000 7f59cf952640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f59b40a2ac0 0x7f59b40a4f80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.989+0000 7f59cf952640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c81025f0 0x7f59c819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.989+0000 7f59cf952640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8101c30 0x7f59c8197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.989+0000 7f59cf952640 1 --2- 172.21.15.73:0/2682638309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c8100a40 0x7f59c8196c50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.989+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 >> 172.21.15.73:0/2682638309 conn(0x7f59c80fc1e0 msgr2=0x7f59c8104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.989+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 shutdown_connections 2024-09-10T07:49:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:09.989+0000 7f59cf952640 1 -- 172.21.15.73:0/2682638309 wait complete. 2024-09-10T07:49:09.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T07:49:10.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.102+0000 7f9ac294b640 1 -- 172.21.15.73:0/23652952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 msgr2=0x7f9abc1105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.102+0000 7f9ac294b640 1 --2- 172.21.15.73:0/23652952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 0x7f9abc1105d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009cd0 tx=0x7f9ab402a8d0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.102+0000 7f9ac294b640 1 -- 172.21.15.73:0/23652952 shutdown_connections 2024-09-10T07:49:10.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.102+0000 7f9ac294b640 1 --2- 172.21.15.73:0/23652952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 0x7f9abc1105d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.102+0000 7f9ac294b640 1 --2- 172.21.15.73:0/23652952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc109380 0x7f9abc109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.102+0000 7f9ac294b640 1 --2- 172.21.15.73:0/23652952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9abc1084c0 0x7f9abc1088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.102+0000 7f9ac294b640 1 -- 172.21.15.73:0/23652952 >> 172.21.15.73:0/23652952 conn(0x7f9abc077490 msgr2=0x7f9abc0798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:10.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.102+0000 7f9ac294b640 1 -- 172.21.15.73:0/23652952 shutdown_connections 2024-09-10T07:49:10.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.102+0000 7f9ac294b640 1 -- 172.21.15.73:0/23652952 wait complete. 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac294b640 1 Processor -- start 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac294b640 1 -- start start 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac294b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc1084c0 0x7f9abc19e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac294b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9abc109380 0x7f9abc19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac294b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 0x7f9abc1a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac294b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc113e20 con 0x7f9abc109d40 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac294b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc113ca0 con 0x7f9abc109380 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac294b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc113fa0 con 0x7f9abc1084c0 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac0ee8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 0x7f9abc1a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9abbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc1084c0 0x7f9abc19e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:10.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.103+0000 7f9ac0ee8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 0x7f9abc1a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48340/0 (socket says 172.21.15.73:48340) 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9ac0ee8640 1 -- 172.21.15.73:0/3471140507 learned_addr learned my addr 172.21.15.73:0/3471140507 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9abb7fe640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9abc109380 0x7f9abc19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9abb7fe640 1 -- 172.21.15.73:0/3471140507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc1084c0 msgr2=0x7f9abc19e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9abb7fe640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc1084c0 0x7f9abc19e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9abb7fe640 1 -- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 msgr2=0x7f9abc1a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9abb7fe640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 0x7f9abc1a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9abb7fe640 1 -- 172.21.15.73:0/3471140507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc1a6000 con 0x7f9abc109380 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9abbfff640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc1084c0 0x7f9abc19e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9ac0ee8640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 0x7f9abc1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9abb7fe640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9abc109380 0x7f9abc19e920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000e9f0 tx=0x7f9ab000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9ab97fa640 1 -- 172.21.15.73:0/3471140507 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000ccc0 con 0x7f9abc109380 2024-09-10T07:49:10.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9ab97fa640 1 -- 172.21.15.73:0/3471140507 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ab0010910 con 0x7f9abc109380 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc1a62f0 con 0x7f9abc109380 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9ab97fa640 1 -- 172.21.15.73:0/3471140507 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0018960 con 0x7f9abc109380 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.104+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc1a6840 con 0x7f9abc109380 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.105+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9abc10f4b0 con 0x7f9abc109380 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.106+0000 7f9ab97fa640 1 -- 172.21.15.73:0/3471140507 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f9ab0010ac0 con 0x7f9abc109380 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.107+0000 7f9ab97fa640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f9aa40a2a40 0x7f9aa40a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.107+0000 7f9abbfff640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f9aa40a2a40 0x7f9aa40a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.108+0000 7f9ab97fa640 1 -- 172.21.15.73:0/3471140507 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8628+0+0 (secure 0 0 0) 0x7f9ab00cf1b0 con 0x7f9abc109380 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.108+0000 7f9abbfff640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f9aa40a2a40 0x7f9aa40a4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9abc1091e0 tx=0x7f9aac005f90 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.110+0000 7f9ab97fa640 1 -- 172.21.15.73:0/3471140507 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ab009bbe0 con 0x7f9abc109380 2024-09-10T07:49:10.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:09 smithi102 ceph-mon[35514]: mgrmap e21: x(active, since 1.02023s), standbys: z, y 2024-09-10T07:49:10.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:09 smithi102 ceph-mon[35514]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:10.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:09 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1832694676' entity='client.admin' 2024-09-10T07:49:10.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:09 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/30857502' entity='client.admin' 2024-09-10T07:49:10.156 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:09 smithi159 ceph-mon[35522]: mgrmap e21: x(active, since 1.02023s), standbys: z, y 2024-09-10T07:49:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:09 smithi159 ceph-mon[35522]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:09 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1832694676' entity='client.admin' 2024-09-10T07:49:10.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:09 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/30857502' entity='client.admin' 2024-09-10T07:49:10.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.168+0000 7f9ab97fa640 1 -- 172.21.15.73:0/3471140507 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7f9ab0098250 con 0x7f9abc109380 2024-09-10T07:49:10.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.325+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 --> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f9abc062630 con 0x7f9aa40a2a40 2024-09-10T07:49:10.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.331+0000 7f9ab97fa640 1 -- 172.21.15.73:0/3471140507 <== mgr.15066 v2:172.21.15.73:6800/3122839464 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f9abc062630 con 0x7f9aa40a2a40 2024-09-10T07:49:10.331 INFO:teuthology.orchestra.run.smithi073.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T07:49:09", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-10T07:49:10.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f9aa40a2a40 msgr2=0x7f9aa40a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f9aa40a2a40 0x7f9aa40a4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9abc1091e0 tx=0x7f9aac005f90 comp rx=0 tx=0).stop 2024-09-10T07:49:10.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9abc109380 msgr2=0x7f9abc19e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9abc109380 0x7f9abc19e920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000e9f0 tx=0x7f9ab000eeb0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 shutdown_connections 2024-09-10T07:49:10.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f9aa40a2a40 0x7f9aa40a4f00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9abc109d40 0x7f9abc1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9abc109380 0x7f9abc19e920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 --2- 172.21.15.73:0/3471140507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc1084c0 0x7f9abc19e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 >> 172.21.15.73:0/3471140507 conn(0x7f9abc077490 msgr2=0x7f9abc10c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:10.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 shutdown_connections 2024-09-10T07:49:10.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.334+0000 7f9ac294b640 1 -- 172.21.15.73:0/3471140507 wait complete. 2024-09-10T07:49:10.344 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T07:49:10.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.448+0000 7fbaae711640 1 -- 172.21.15.73:0/2134926470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 msgr2=0x7fbaa8108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.448+0000 7fbaae711640 1 --2- 172.21.15.73:0/2134926470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 0x7fbaa8108e80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009ca0 tx=0x7fbaa002a8c0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.448+0000 7fbaae711640 1 -- 172.21.15.73:0/2134926470 shutdown_connections 2024-09-10T07:49:10.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.448+0000 7fbaae711640 1 --2- 172.21.15.73:0/2134926470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 0x7fbaa8108e80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.448+0000 7fbaae711640 1 --2- 172.21.15.73:0/2134926470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbaa8101c30 0x7fbaa81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.448+0000 7fbaae711640 1 --2- 172.21.15.73:0/2134926470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaa8100a40 0x7fbaa8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.448+0000 7fbaae711640 1 -- 172.21.15.73:0/2134926470 >> 172.21.15.73:0/2134926470 conn(0x7fbaa80fc1e0 msgr2=0x7fbaa80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:10.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.448+0000 7fbaae711640 1 -- 172.21.15.73:0/2134926470 shutdown_connections 2024-09-10T07:49:10.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.448+0000 7fbaae711640 1 -- 172.21.15.73:0/2134926470 wait complete. 2024-09-10T07:49:10.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaae711640 1 Processor -- start 2024-09-10T07:49:10.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaae711640 1 -- start start 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaae711640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaa8100a40 0x7fbaa8196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaae711640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbaa8101c30 0x7fbaa81971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaae711640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 0x7fbaa819e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaae711640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa810c6c0 con 0x7fbaa81025f0 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaae711640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa810c540 con 0x7fbaa8100a40 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaae711640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa810c840 con 0x7fbaa8101c30 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaaccae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 0x7fbaa819e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.449+0000 7fbaaccae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 0x7fbaa819e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48360/0 (socket says 172.21.15.73:48360) 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaaccae640 1 -- 172.21.15.73:0/3636598220 learned_addr learned my addr 172.21.15.73:0/3636598220 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:49:10.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaa7fff640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaa8100a40 0x7fbaa8196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaa77fe640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbaa8101c30 0x7fbaa81971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaaccae640 1 -- 172.21.15.73:0/3636598220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbaa8101c30 msgr2=0x7fbaa81971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaaccae640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbaa8101c30 0x7fbaa81971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaaccae640 1 -- 172.21.15.73:0/3636598220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaa8100a40 msgr2=0x7fbaa8196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaaccae640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaa8100a40 0x7fbaa8196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaaccae640 1 -- 172.21.15.73:0/3636598220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa819e8c0 con 0x7fbaa81025f0 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaa7fff640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaa8100a40 0x7fbaa8196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaaccae640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 0x7fbaa819e220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0031ae0 tx=0x7fbaa0031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.450+0000 7fbaa57fa640 1 -- 172.21.15.73:0/3636598220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0003b70 con 0x7fbaa81025f0 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.451+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa819eb50 con 0x7fbaa81025f0 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.451+0000 7fbaa57fa640 1 -- 172.21.15.73:0/3636598220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa0003d10 con 0x7fbaa81025f0 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.451+0000 7fbaa57fa640 1 -- 172.21.15.73:0/3636598220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa002fc40 con 0x7fbaa81025f0 2024-09-10T07:49:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.451+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa819f0f0 con 0x7fbaa81025f0 2024-09-10T07:49:10.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.452+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa8107d60 con 0x7fbaa81025f0 2024-09-10T07:49:10.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.453+0000 7fbaa57fa640 1 -- 172.21.15.73:0/3636598220 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7fbaa0004050 con 0x7fbaa81025f0 2024-09-10T07:49:10.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.453+0000 7fbaa57fa640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fba900a2da0 0x7fba900a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:49:10.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.454+0000 7fbaa7fff640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fba900a2da0 0x7fba900a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:49:10.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.454+0000 7fbaa57fa640 1 -- 172.21.15.73:0/3636598220 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8628+0+0 (secure 0 0 0) 0x7fbaa00f0690 con 0x7fbaa81025f0 2024-09-10T07:49:10.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.454+0000 7fbaa7fff640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fba900a2da0 0x7fba900a5260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8197b50 tx=0x7fba98005f90 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:49:10.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.457+0000 7fbaa57fa640 1 -- 172.21.15.73:0/3636598220 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbaa00bd350 con 0x7fbaa81025f0 2024-09-10T07:49:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.673+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 --> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fbaa8062630 con 0x7fba900a2da0 2024-09-10T07:49:10.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.680+0000 7fbaa57fa640 1 -- 172.21.15.73:0/3636598220 <== mgr.15066 v2:172.21.15.73:6800/3122839464 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fbaa8062630 con 0x7fba900a2da0 2024-09-10T07:49:10.679 INFO:teuthology.orchestra.run.smithi073.stdout:/ 1m 6m3h 2024-09-10T07:49:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.683+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fba900a2da0 msgr2=0x7fba900a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.683+0000 7fbaae711640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fba900a2da0 0x7fba900a5260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8197b50 tx=0x7fba98005f90 comp rx=0 tx=0).stop 2024-09-10T07:49:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.683+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 msgr2=0x7fbaa819e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:49:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.683+0000 7fbaae711640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 0x7fbaa819e220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0031ae0 tx=0x7fbaa0031ee0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.683+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 shutdown_connections 2024-09-10T07:49:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.683+0000 7fbaae711640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fba900a2da0 0x7fba900a5260 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.683+0000 7fbaae711640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa81025f0 0x7fbaa819e220 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.684+0000 7fbaae711640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbaa8101c30 0x7fbaa81971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.684+0000 7fbaae711640 1 --2- 172.21.15.73:0/3636598220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaa8100a40 0x7fbaa8196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:49:10.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.684+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 >> 172.21.15.73:0/3636598220 conn(0x7fbaa80fc1e0 msgr2=0x7fbaa8104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:49:10.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.684+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 shutdown_connections 2024-09-10T07:49:10.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:49:10.684+0000 7fbaae711640 1 -- 172.21.15.73:0/3636598220 wait complete. 2024-09-10T07:49:10.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-10T07:49:10.724 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-10T07:49:10.734 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T07:49:11.176 INFO:tasks.workunit:Pulling workunits from ref 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:49:11.177 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T07:49:11.177 INFO:tasks.workunit:timeout=3h 2024-09-10T07:49:11.177 INFO:tasks.workunit:cleanup=True 2024-09-10T07:49:11.177 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T07:49:11.179 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: [10/Sep/2024:07:49:09] ENGINE Bus STARTING 2024-09-10T07:49:11.179 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: [10/Sep/2024:07:49:09] ENGINE Serving on http://172.21.15.73:8765 2024-09-10T07:49:11.179 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: [10/Sep/2024:07:49:09] ENGINE Serving on https://172.21.15.73:7150 2024-09-10T07:49:11.179 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: [10/Sep/2024:07:49:09] ENGINE Bus STARTED 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: [10/Sep/2024:07:49:09] ENGINE Error in HTTPServer.serve 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: Traceback (most recent call last): 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: self._connections.run(self.expiration_interval) 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: self._run(expiration_interval) 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: s = self.context.wrap_socket( 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: return self.sslsocket_class._create( 2024-09-10T07:49:11.180 INFO:journalctl@ceph.mon.c.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout: self.do_handshake() 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout: self._sslobj.do_handshake() 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.181 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.182 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:10 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: [10/Sep/2024:07:49:09] ENGINE Bus STARTING 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: [10/Sep/2024:07:49:09] ENGINE Serving on http://172.21.15.73:8765 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: [10/Sep/2024:07:49:09] ENGINE Serving on https://172.21.15.73:7150 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: [10/Sep/2024:07:49:09] ENGINE Bus STARTED 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: [10/Sep/2024:07:49:09] ENGINE Error in HTTPServer.serve 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.b.smithi102.stdout: Traceback (most recent call last): 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.b.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:49:11.183 INFO:journalctl@ceph.mon.b.smithi102.stdout: self._connections.run(self.expiration_interval) 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: self._run(expiration_interval) 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: s = self.context.wrap_socket( 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: return self.sslsocket_class._create( 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: self.do_handshake() 2024-09-10T07:49:11.184 INFO:journalctl@ceph.mon.b.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout: self._sslobj.do_handshake() 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.185 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.186 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:10 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: [10/Sep/2024:07:49:09] ENGINE Bus STARTING 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: [10/Sep/2024:07:49:09] ENGINE Serving on http://172.21.15.73:8765 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: [10/Sep/2024:07:49:09] ENGINE Serving on https://172.21.15.73:7150 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: [10/Sep/2024:07:49:09] ENGINE Bus STARTED 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: [10/Sep/2024:07:49:09] ENGINE Error in HTTPServer.serve 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout: Traceback (most recent call last): 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._connections.run(self.expiration_interval) 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._run(expiration_interval) 2024-09-10T07:49:11.187 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: s = self.context.wrap_socket( 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: return self.sslsocket_class._create( 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: self.do_handshake() 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: self._sslobj.do_handshake() 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:11.188 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.189 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:49:11.190 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:10 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:49:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T07:49:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T07:49:11.205 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T07:49:11.205 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:49:11.205 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T07:49:11.205 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-10 07:47:48.423397338 +0000 2024-09-10T07:49:11.205 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-10 07:47:48.423397338 +0000 2024-09-10T07:49:11.205 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-10 07:49:07.778262739 +0000 2024-09-10T07:49:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-10 07:47:48.423397338 +0000 2024-09-10T07:49:11.205 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T07:49:11.206 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T07:49:11.274 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:49:11.330 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Unable to set osd_memory_target on smithi159 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Unable to set osd_memory_target on smithi102 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-10T07:49:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:49:12.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:49:12.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:49:12.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-10T07:49:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Unable to set osd_memory_target on smithi159 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-10T07:49:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-10T07:49:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Unable to set osd_memory_target on smithi102 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-10T07:49:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:49:12.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:49:12.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:49:12.159 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:12.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:12.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-10T07:49:12.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Unable to set osd_memory_target on smithi159 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Unable to set osd_memory_target on smithi102 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:12.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:49:12.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:49:12.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:49:12.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:49:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:12 smithi102 ceph-mon[35514]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:49:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:12 smithi102 ceph-mon[35514]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:49:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:12 smithi102 ceph-mon[35514]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:49:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:12 smithi102 ceph-mon[35514]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:49:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:12 smithi102 ceph-mon[35514]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:49:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:12 smithi102 ceph-mon[35514]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:49:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:12 smithi102 ceph-mon[35514]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:12 smithi102 ceph-mon[35514]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-10T07:49:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:12 smithi159 ceph-mon[35522]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:49:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:12 smithi159 ceph-mon[35522]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:49:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:12 smithi159 ceph-mon[35522]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:49:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:12 smithi159 ceph-mon[35522]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:49:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:12 smithi159 ceph-mon[35522]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:49:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:12 smithi159 ceph-mon[35522]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:49:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:12 smithi159 ceph-mon[35522]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:12 smithi159 ceph-mon[35522]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-10T07:49:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:12 smithi073 ceph-mon[30850]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:49:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:12 smithi073 ceph-mon[30850]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:49:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:12 smithi073 ceph-mon[30850]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-10T07:49:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:12 smithi073 ceph-mon[30850]: Updating smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:49:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:12 smithi073 ceph-mon[30850]: Updating smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:49:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:12 smithi073 ceph-mon[30850]: Updating smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T07:49:13.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:12 smithi073 ceph-mon[30850]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:13.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:12 smithi073 ceph-mon[30850]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-10T07:49:15.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:14 smithi102 ceph-mon[35514]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:15.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:14 smithi159 ceph-mon[35522]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:14 smithi073 ceph-mon[30850]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T07:49:17.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:16 smithi102 ceph-mon[35514]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-09-10T07:49:17.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:16 smithi159 ceph-mon[35522]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-09-10T07:49:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:16 smithi073 ceph-mon[30850]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-09-10T07:49:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:18 smithi102 ceph-mon[35514]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 102 KiB/s wr, 57 op/s 2024-09-10T07:49:19.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:18 smithi159 ceph-mon[35522]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 102 KiB/s wr, 57 op/s 2024-09-10T07:49:19.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:18 smithi073 ceph-mon[30850]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 102 KiB/s wr, 57 op/s 2024-09-10T07:49:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:20 smithi102 ceph-mon[35514]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-09-10T07:49:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:20 smithi159 ceph-mon[35522]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-09-10T07:49:21.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:20 smithi073 ceph-mon[30850]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-09-10T07:49:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:22 smithi102 ceph-mon[35514]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-10T07:49:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:22 smithi159 ceph-mon[35522]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-10T07:49:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:22 smithi073 ceph-mon[30850]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-10T07:49:25.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:24 smithi102 ceph-mon[35514]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-10T07:49:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:24 smithi159 ceph-mon[35522]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-10T07:49:25.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:24 smithi073 ceph-mon[30850]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-10T07:49:27.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:26 smithi102 ceph-mon[35514]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-10T07:49:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:26 smithi159 ceph-mon[35522]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-10T07:49:27.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:26 smithi073 ceph-mon[30850]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-10T07:49:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:28 smithi102 ceph-mon[35514]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:28 smithi159 ceph-mon[35522]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:29.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:28 smithi073 ceph-mon[30850]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:31.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:30 smithi102 ceph-mon[35514]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:31.156 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:30 smithi159 ceph-mon[35522]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:30 smithi073 ceph-mon[30850]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:33.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:32 smithi102 ceph-mon[35514]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:32 smithi159 ceph-mon[35522]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:32 smithi073 ceph-mon[30850]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:35.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:34 smithi102 ceph-mon[35514]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:34 smithi159 ceph-mon[35522]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:34 smithi073 ceph-mon[30850]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:37.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:36 smithi102 ceph-mon[35514]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:36 smithi159 ceph-mon[35522]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:36 smithi073 ceph-mon[30850]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:39.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:38 smithi102 ceph-mon[35514]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:39.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:38 smithi159 ceph-mon[35522]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:39.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:38 smithi073 ceph-mon[30850]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:41.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:40 smithi102 ceph-mon[35514]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:41.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:40 smithi159 ceph-mon[35522]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:41.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:40 smithi073 ceph-mon[30850]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:43.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:42 smithi102 ceph-mon[35514]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:43.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:42 smithi159 ceph-mon[35522]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:43.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:42 smithi073 ceph-mon[30850]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:45.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:44 smithi102 ceph-mon[35514]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:45.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:44 smithi159 ceph-mon[35522]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:45.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:44 smithi073 ceph-mon[30850]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:46.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:46 smithi159 ceph-mon[35522]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:46.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:46 smithi073 ceph-mon[30850]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:46.625 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:46 smithi102 ceph-mon[35514]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:49:49.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:48 smithi102 ceph-mon[35514]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:49.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:48 smithi159 ceph-mon[35522]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:48 smithi073 ceph-mon[30850]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:49:51.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:50 smithi102 ceph-mon[35514]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:51.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:50 smithi159 ceph-mon[35522]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:51.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:50 smithi073 ceph-mon[30850]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:53.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:52 smithi102 ceph-mon[35514]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:53.156 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:52 smithi159 ceph-mon[35522]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:52 smithi073 ceph-mon[30850]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:55.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:54 smithi102 ceph-mon[35514]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:55.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:54 smithi159 ceph-mon[35522]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:55.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:54 smithi073 ceph-mon[30850]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:57.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:56 smithi102 ceph-mon[35514]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:57.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:56 smithi159 ceph-mon[35522]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:57.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:56 smithi073 ceph-mon[30850]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:59.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:49:58 smithi102 ceph-mon[35514]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:49:58 smithi159 ceph-mon[35522]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:49:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:49:58 smithi073 ceph-mon[30850]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:50:01.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:00 smithi102 ceph-mon[35514]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:50:01.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:00 smithi102 ceph-mon[35514]: overall HEALTH_OK 2024-09-10T07:50:01.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:00 smithi159 ceph-mon[35522]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:50:01.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:00 smithi159 ceph-mon[35522]: overall HEALTH_OK 2024-09-10T07:50:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:00 smithi073 ceph-mon[30850]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-10T07:50:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:00 smithi073 ceph-mon[30850]: overall HEALTH_OK 2024-09-10T07:50:01.223 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:50:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:50:00.998+0000 7f3b36ff8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:50:01.223 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:50:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:50:00.999+0000 7f3b36ff8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:50:01.223 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:50:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:50:00.999+0000 7f3b36ff8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:50:01.223 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:50:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:50:00.999+0000 7f3b36ff8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:50:01.223 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:50:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:50:00.999+0000 7f3b36ff8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T07:50:03.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:02 smithi102 ceph-mon[35514]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:50:03.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:02 smithi102 ceph-mon[35514]: mgrmap e24: x(active, since 54s), standbys: z, y 2024-09-10T07:50:03.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:02 smithi159 ceph-mon[35522]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:50:03.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:02 smithi159 ceph-mon[35522]: mgrmap e24: x(active, since 54s), standbys: z, y 2024-09-10T07:50:03.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:02 smithi073 ceph-mon[30850]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:50:03.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:02 smithi073 ceph-mon[30850]: mgrmap e24: x(active, since 54s), standbys: z, y 2024-09-10T07:50:05.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:04 smithi102 ceph-mon[35514]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:50:05.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:04 smithi159 ceph-mon[35522]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:50:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:04 smithi073 ceph-mon[30850]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:50:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:05 smithi073 ceph-mon[30850]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-10T07:50:06.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:05 smithi102 ceph-mon[35514]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-10T07:50:06.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:05 smithi159 ceph-mon[35522]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-10T07:50:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:08 smithi102 ceph-mon[35514]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:50:09.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:08 smithi159 ceph-mon[35522]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:50:09.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:08 smithi073 ceph-mon[30850]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-09-10T07:50:10.329 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-10T07:50:10.330 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-09-10T07:50:10.330 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-10T07:50:10.330 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-09-10T07:50:10.330 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-10T07:50:10.330 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T07:50:10.330 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-10T07:50:10.330 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T07:50:10.334 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T07:50:10.397 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T07:50:10.399 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T07:50:10.399 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T07:50:11.085 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T07:50:11.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:10 smithi102 ceph-mon[35514]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-10T07:50:11.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:10 smithi159 ceph-mon[35522]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-10T07:50:11.161 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T07:50:11.201 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T07:50:11.203 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T07:50:11.203 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T07:50:11.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:10 smithi073 ceph-mon[30850]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-10T07:50:11.241 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T07:50:11.244 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:50:11.244 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T07:50:11.301 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-10T07:50:11.304 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-10T07:50:11.304 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-10T07:50:11.363 INFO:tasks.workunit.client.0.smithi073.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-10T07:50:11.364 INFO:tasks.workunit.client.0.smithi073.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-10T07:50:11.364 INFO:tasks.workunit.client.0.smithi073.stderr:+ trap -- retry EXIT 2024-09-10T07:50:11.364 INFO:tasks.workunit.client.0.smithi073.stderr:+ rm -rf ffsb 2024-09-10T07:50:11.364 INFO:tasks.workunit.client.0.smithi073.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-10T07:50:11.367 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into 'ffsb'... 2024-09-10T07:50:12.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:11 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:50:12.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:11 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:50:12.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:11 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:50:12.304 INFO:tasks.workunit.client.0.smithi073.stderr:+ trap - EXIT 2024-09-10T07:50:12.304 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd ffsb 2024-09-10T07:50:12.304 INFO:tasks.workunit.client.0.smithi073.stderr:+ ./configure 2024-09-10T07:50:12.436 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T07:50:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:12 smithi102 ceph-mon[35514]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:50:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:12 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:50:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:12 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:50:13.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:12 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:50:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:12 smithi159 ceph-mon[35522]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:50:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:12 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:50:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:12 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:50:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:12 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:50:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:12 smithi073 ceph-mon[30850]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:50:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:12 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:50:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:12 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:50:13.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:12 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:50:13.444 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether build environment is sane... yes 2024-09-10T07:50:13.454 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-10T07:50:13.454 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gawk... gawk 2024-09-10T07:50:13.471 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether make sets $(MAKE)... yes 2024-09-10T07:50:13.508 INFO:tasks.workunit.client.0.smithi073.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-10T07:50:13.508 INFO:tasks.workunit.client.0.smithi073.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-10T07:50:13.520 INFO:tasks.workunit.client.0.smithi073.stdout:checking for style of include used by make... GNU 2024-09-10T07:50:13.525 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... gcc 2024-09-10T07:50:13.582 INFO:tasks.workunit.client.0.smithi073.stdout:checking for C compiler default output file name... a.out 2024-09-10T07:50:13.583 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether the C compiler works... yes 2024-09-10T07:50:13.587 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are cross compiling... no 2024-09-10T07:50:13.625 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of executables... 2024-09-10T07:50:13.658 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of object files... o 2024-09-10T07:50:13.689 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... yes 2024-09-10T07:50:13.719 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... yes 2024-09-10T07:50:13.781 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-10T07:50:13.878 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... gcc3 2024-09-10T07:50:13.964 INFO:tasks.workunit.client.0.smithi073.stdout:checking how to run the C preprocessor... gcc -E 2024-09-10T07:50:14.004 INFO:tasks.workunit.client.0.smithi073.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-10T07:50:14.005 INFO:tasks.workunit.client.0.smithi073.stdout:checking for egrep... /usr/bin/grep -E 2024-09-10T07:50:14.014 INFO:tasks.workunit.client.0.smithi073.stdout:checking for AIX... no 2024-09-10T07:50:14.032 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... (cached) gcc 2024-09-10T07:50:14.039 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-10T07:50:14.041 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-10T07:50:14.041 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-10T07:50:14.041 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-10T07:50:14.097 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lm... yes 2024-09-10T07:50:14.145 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lpthread... yes 2024-09-10T07:50:14.288 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... yes 2024-09-10T07:50:14.348 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-10T07:50:14.391 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/types.h... yes 2024-09-10T07:50:14.435 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/stat.h... yes 2024-09-10T07:50:14.479 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdlib.h... yes 2024-09-10T07:50:14.525 INFO:tasks.workunit.client.0.smithi073.stdout:checking for string.h... yes 2024-09-10T07:50:14.570 INFO:tasks.workunit.client.0.smithi073.stdout:checking for memory.h... yes 2024-09-10T07:50:14.615 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strings.h... yes 2024-09-10T07:50:14.660 INFO:tasks.workunit.client.0.smithi073.stdout:checking for inttypes.h... yes 2024-09-10T07:50:14.705 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... yes 2024-09-10T07:50:14.751 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... yes 2024-09-10T07:50:14.809 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h usability... yes 2024-09-10T07:50:14.831 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h presence... yes 2024-09-10T07:50:14.832 INFO:tasks.workunit.client.0.smithi073.stdout:checking for pthread.h... yes 2024-09-10T07:50:14.881 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h usability... yes 2024-09-10T07:50:14.900 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h presence... yes 2024-09-10T07:50:14.900 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fcntl.h... yes 2024-09-10T07:50:14.951 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h usability... yes 2024-09-10T07:50:14.971 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h presence... yes 2024-09-10T07:50:14.971 INFO:tasks.workunit.client.0.smithi073.stdout:checking for limits.h... yes 2024-09-10T07:50:14.984 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... (cached) yes 2024-09-10T07:50:15.034 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h usability... yes 2024-09-10T07:50:15.054 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h presence... yes 2024-09-10T07:50:15.054 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/time.h... yes 2024-09-10T07:50:15.069 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... (cached) yes 2024-09-10T07:50:15.115 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h usability... yes 2024-09-10T07:50:15.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:14 smithi102 ceph-mon[35514]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 KiB/s wr, 17 op/s 2024-09-10T07:50:15.134 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h presence... yes 2024-09-10T07:50:15.134 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/vfs.h... yes 2024-09-10T07:50:15.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:14 smithi159 ceph-mon[35522]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 KiB/s wr, 17 op/s 2024-09-10T07:50:15.182 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h usability... no 2024-09-10T07:50:15.201 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h presence... no 2024-09-10T07:50:15.202 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/limits.h... no 2024-09-10T07:50:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:14 smithi073 ceph-mon[30850]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 KiB/s wr, 17 op/s 2024-09-10T07:50:15.232 INFO:tasks.workunit.client.0.smithi073.stdout:checking for an ANSI C-conforming const... yes 2024-09-10T07:50:15.265 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-10T07:50:15.266 INFO:tasks.workunit.client.0.smithi073.stdout:checking for function prototypes... yes 2024-09-10T07:50:15.292 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether setvbuf arguments are reversed... no 2024-09-10T07:50:15.374 INFO:tasks.workunit.client.0.smithi073.stdout:checking for system... yes 2024-09-10T07:50:15.436 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gettimeofday... yes 2024-09-10T07:50:15.500 INFO:tasks.workunit.client.0.smithi073.stdout:checking for mkdir... yes 2024-09-10T07:50:15.561 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strerror... yes 2024-09-10T07:50:15.621 INFO:tasks.workunit.client.0.smithi073.stdout:checking for open64... yes 2024-09-10T07:50:15.681 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stat64... yes 2024-09-10T07:50:15.741 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fseeko64... yes 2024-09-10T07:50:15.800 INFO:tasks.workunit.client.0.smithi073.stdout:checking for lrand48_r... yes 2024-09-10T07:50:15.861 INFO:tasks.workunit.client.0.smithi073.stdout:checking for srand48_r... yes 2024-09-10T07:50:15.884 INFO:tasks.workunit.client.0.smithi073.stdout:configure: creating ./config.status 2024-09-10T07:50:15.973 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating Makefile 2024-09-10T07:50:15.986 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2024-09-10T07:50:16.002 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing depfiles commands 2024-09-10T07:50:16.044 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing default commands 2024-09-10T07:50:16.094 INFO:tasks.workunit.client.0.smithi073.stderr:+ make 2024-09-10T07:50:16.100 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-10T07:50:16.102 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-10T07:50:16.103 INFO:tasks.workunit.client.0.smithi073.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-10T07:50:16.103 INFO:tasks.workunit.client.0.smithi073.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-10T07:50:16.103 INFO:tasks.workunit.client.0.smithi073.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-10T07:50:16.103 INFO:tasks.workunit.client.0.smithi073.stderr: any GNU archive site. 2024-09-10T07:50:16.104 INFO:tasks.workunit.client.0.smithi073.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-10T07:50:16.105 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-10T07:50:16.106 INFO:tasks.workunit.client.0.smithi073.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-10T07:50:16.106 INFO:tasks.workunit.client.0.smithi073.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-10T07:50:16.106 INFO:tasks.workunit.client.0.smithi073.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-10T07:50:16.106 INFO:tasks.workunit.client.0.smithi073.stderr: Grab them from any GNU archive site. 2024-09-10T07:50:16.144 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-10T07:50:16.437 INFO:tasks.workunit.client.0.smithi073.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-10T07:50:16.438 INFO:tasks.workunit.client.0.smithi073.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-10T07:50:16.438 INFO:tasks.workunit.client.0.smithi073.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-10T07:50:16.438 INFO:tasks.workunit.client.0.smithi073.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-10T07:50:16.554 INFO:tasks.workunit.client.0.smithi073.stdout:/bin/sh ./config.status --recheck 2024-09-10T07:50:16.604 INFO:tasks.workunit.client.0.smithi073.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-10T07:50:16.699 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T07:50:17.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:16 smithi102 ceph-mon[35514]: pgmap v37: 97 pgs: 97 active+clean; 2.9 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 157 KiB/s wr, 25 op/s 2024-09-10T07:50:17.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:16 smithi159 ceph-mon[35522]: pgmap v37: 97 pgs: 97 active+clean; 2.9 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 157 KiB/s wr, 25 op/s 2024-09-10T07:50:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:16 smithi073 ceph-mon[30850]: pgmap v37: 97 pgs: 97 active+clean; 2.9 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 157 KiB/s wr, 25 op/s 2024-09-10T07:50:17.707 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether build environment is sane... yes 2024-09-10T07:50:17.711 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-10T07:50:17.711 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gawk... gawk 2024-09-10T07:50:17.725 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether make sets $(MAKE)... yes 2024-09-10T07:50:17.755 INFO:tasks.workunit.client.0.smithi073.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-10T07:50:17.755 INFO:tasks.workunit.client.0.smithi073.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-10T07:50:17.767 INFO:tasks.workunit.client.0.smithi073.stdout:checking for style of include used by make... GNU 2024-09-10T07:50:17.773 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... gcc 2024-09-10T07:50:17.865 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether the C compiler works... yes 2024-09-10T07:50:17.865 INFO:tasks.workunit.client.0.smithi073.stdout:checking for C compiler default output file name... a.out 2024-09-10T07:50:17.904 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of executables... 2024-09-10T07:50:17.943 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are cross compiling... no 2024-09-10T07:50:17.983 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of object files... o 2024-09-10T07:50:18.009 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... yes 2024-09-10T07:50:18.036 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... yes 2024-09-10T07:50:18.079 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-10T07:50:18.189 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... gcc3 2024-09-10T07:50:18.239 INFO:tasks.workunit.client.0.smithi073.stdout:checking how to run the C preprocessor... gcc -E 2024-09-10T07:50:18.293 INFO:tasks.workunit.client.0.smithi073.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-10T07:50:18.294 INFO:tasks.workunit.client.0.smithi073.stdout:checking for egrep... /usr/bin/grep -E 2024-09-10T07:50:18.421 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... yes 2024-09-10T07:50:18.454 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/types.h... yes 2024-09-10T07:50:18.491 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/stat.h... yes 2024-09-10T07:50:18.528 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdlib.h... yes 2024-09-10T07:50:18.572 INFO:tasks.workunit.client.0.smithi073.stdout:checking for string.h... yes 2024-09-10T07:50:18.613 INFO:tasks.workunit.client.0.smithi073.stdout:checking for memory.h... yes 2024-09-10T07:50:18.654 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strings.h... yes 2024-09-10T07:50:18.694 INFO:tasks.workunit.client.0.smithi073.stdout:checking for inttypes.h... yes 2024-09-10T07:50:18.736 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... yes 2024-09-10T07:50:18.780 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... yes 2024-09-10T07:50:18.826 INFO:tasks.workunit.client.0.smithi073.stdout:checking minix/config.h usability... no 2024-09-10T07:50:18.857 INFO:tasks.workunit.client.0.smithi073.stdout:checking minix/config.h presence... no 2024-09-10T07:50:18.857 INFO:tasks.workunit.client.0.smithi073.stdout:checking for minix/config.h... no 2024-09-10T07:50:18.890 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-10T07:50:18.890 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... (cached) gcc 2024-09-10T07:50:18.923 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-10T07:50:18.923 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-10T07:50:18.923 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-10T07:50:18.923 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-10T07:50:18.964 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lm... yes 2024-09-10T07:50:19.008 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lpthread... yes 2024-09-10T07:50:19.009 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... (cached) yes 2024-09-10T07:50:19.038 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-10T07:50:19.098 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h usability... yes 2024-09-10T07:50:19.116 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h presence... yes 2024-09-10T07:50:19.116 INFO:tasks.workunit.client.0.smithi073.stdout:checking for pthread.h... yes 2024-09-10T07:50:19.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:18 smithi102 ceph-mon[35514]: pgmap v38: 97 pgs: 97 active+clean; 2.9 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-09-10T07:50:19.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:18 smithi159 ceph-mon[35522]: pgmap v38: 97 pgs: 97 active+clean; 2.9 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-09-10T07:50:19.162 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h usability... yes 2024-09-10T07:50:19.178 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h presence... yes 2024-09-10T07:50:19.178 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fcntl.h... yes 2024-09-10T07:50:19.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:18 smithi073 ceph-mon[30850]: pgmap v38: 97 pgs: 97 active+clean; 2.9 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-09-10T07:50:19.227 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h usability... yes 2024-09-10T07:50:19.242 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h presence... yes 2024-09-10T07:50:19.242 INFO:tasks.workunit.client.0.smithi073.stdout:checking for limits.h... yes 2024-09-10T07:50:19.257 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... (cached) yes 2024-09-10T07:50:19.293 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h usability... yes 2024-09-10T07:50:19.309 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h presence... yes 2024-09-10T07:50:19.309 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/time.h... yes 2024-09-10T07:50:19.322 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... (cached) yes 2024-09-10T07:50:19.358 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h usability... yes 2024-09-10T07:50:19.374 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h presence... yes 2024-09-10T07:50:19.374 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/vfs.h... yes 2024-09-10T07:50:19.422 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h usability... no 2024-09-10T07:50:19.448 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h presence... no 2024-09-10T07:50:19.449 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/limits.h... no 2024-09-10T07:50:19.473 INFO:tasks.workunit.client.0.smithi073.stdout:checking for an ANSI C-conforming const... yes 2024-09-10T07:50:19.500 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-10T07:50:19.556 INFO:tasks.workunit.client.0.smithi073.stdout:checking for system... yes 2024-09-10T07:50:19.610 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gettimeofday... yes 2024-09-10T07:50:19.663 INFO:tasks.workunit.client.0.smithi073.stdout:checking for mkdir... yes 2024-09-10T07:50:19.717 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strerror... yes 2024-09-10T07:50:19.771 INFO:tasks.workunit.client.0.smithi073.stdout:checking for open64... yes 2024-09-10T07:50:19.824 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stat64... yes 2024-09-10T07:50:19.880 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fseeko64... yes 2024-09-10T07:50:19.933 INFO:tasks.workunit.client.0.smithi073.stdout:checking for lrand48_r... yes 2024-09-10T07:50:19.986 INFO:tasks.workunit.client.0.smithi073.stdout:checking for srand48_r... yes 2024-09-10T07:50:20.008 INFO:tasks.workunit.client.0.smithi073.stdout:configure: creating ./config.status 2024-09-10T07:50:20.066 INFO:tasks.workunit.client.0.smithi073.stdout: /bin/sh ./config.status 2024-09-10T07:50:20.112 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating Makefile 2024-09-10T07:50:20.123 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2024-09-10T07:50:20.143 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing depfiles commands 2024-09-10T07:50:20.154 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing default commands 2024-09-10T07:50:20.176 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-10T07:50:20.314 INFO:tasks.workunit.client.0.smithi073.stdout:rm -f stamp-h1 2024-09-10T07:50:20.317 INFO:tasks.workunit.client.0.smithi073.stdout:touch config.h.in 2024-09-10T07:50:20.318 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh ./config.status config.h 2024-09-10T07:50:20.358 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2024-09-10T07:50:20.381 INFO:tasks.workunit.client.0.smithi073.stdout:make all-am 2024-09-10T07:50:20.387 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-10T07:50:20.387 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-10T07:50:20.541 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-10T07:50:20.544 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-10T07:50:20.629 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-10T07:50:20.632 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-10T07:50:20.713 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-10T07:50:20.715 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-10T07:50:20.799 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-10T07:50:20.802 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-10T07:50:20.912 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-10T07:50:20.915 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-10T07:50:20.961 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-10T07:50:20.964 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-10T07:50:21.005 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-10T07:50:21.007 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-10T07:50:21.051 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-10T07:50:21.054 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-10T07:50:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:20 smithi102 ceph-mon[35514]: pgmap v39: 97 pgs: 97 active+clean; 6.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 513 KiB/s wr, 56 op/s 2024-09-10T07:50:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:20 smithi159 ceph-mon[35522]: pgmap v39: 97 pgs: 97 active+clean; 6.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 513 KiB/s wr, 56 op/s 2024-09-10T07:50:21.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:20 smithi073 ceph-mon[30850]: pgmap v39: 97 pgs: 97 active+clean; 6.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 513 KiB/s wr, 56 op/s 2024-09-10T07:50:21.251 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-10T07:50:21.253 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-10T07:50:21.379 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-10T07:50:21.381 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-10T07:50:21.522 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-10T07:50:21.525 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-10T07:50:21.590 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-10T07:50:21.592 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-10T07:50:21.661 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-10T07:50:21.664 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-10T07:50:21.762 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-10T07:50:21.765 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-10T07:50:21.792 INFO:tasks.workunit.client.0.smithi073.stderr:In file included from parser.h:22, 2024-09-10T07:50:21.792 INFO:tasks.workunit.client.0.smithi073.stderr: from parser.c:25: 2024-09-10T07:50:21.792 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘init_filesys’: 2024-09-10T07:50:21.792 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T07:50:21.792 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T07:50:21.792 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-10T07:50:21.792 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-10T07:50:21.793 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T07:50:21.794 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-10T07:50:21.795 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T07:50:21.796 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:21.797 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-10T07:50:21.798 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T07:50:21.799 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T07:50:21.800 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-09-10T07:50:21.801 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T07:50:21.802 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-09-10T07:50:21.802 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-09-10T07:50:21.802 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T07:50:21.802 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T07:50:21.802 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-09-10T07:50:21.802 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T07:50:21.802 INFO:tasks.workunit.client.0.smithi073.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-10T07:50:21.802 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:21.836 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘get_optstr’: 2024-09-10T07:50:21.836 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-10T07:50:21.836 INFO:tasks.workunit.client.0.smithi073.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-10T07:50:21.836 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:21.837 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:200:14: note: source object declared here 2024-09-10T07:50:21.837 INFO:tasks.workunit.client.0.smithi073.stderr: 200 | char temp[BUFSIZE]; 2024-09-10T07:50:21.837 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~ 2024-09-10T07:50:21.842 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘size64_convert’: 2024-09-10T07:50:21.842 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-10T07:50:21.842 INFO:tasks.workunit.client.0.smithi073.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-10T07:50:21.842 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-10T07:50:22.121 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-10T07:50:22.123 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-10T07:50:22.178 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-10T07:50:22.180 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-10T07:50:22.266 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-10T07:50:22.269 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-10T07:50:22.298 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-10T07:50:22.301 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-10T07:50:22.332 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-10T07:50:22.332 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd .. 2024-09-10T07:50:22.332 INFO:tasks.workunit.client.0.smithi073.stderr:+ mkdir tmp 2024-09-10T07:50:22.334 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd tmp 2024-09-10T07:50:22.334 INFO:tasks.workunit.client.0.smithi073.stderr:+ for f in $mydir/*.ffsb 2024-09-10T07:50:22.334 INFO:tasks.workunit.client.0.smithi073.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-10T07:50:22.334 INFO:tasks.workunit.client.0.smithi073.stdout:FFSB version 6.0-RC2 started 2024-09-10T07:50:22.334 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-10T07:50:22.338 INFO:tasks.workunit.client.0.smithi073.stdout:benchmark time = 300 2024-09-10T07:50:22.338 INFO:tasks.workunit.client.0.smithi073.stdout:ThreadGroup 0 2024-09-10T07:50:22.338 INFO:tasks.workunit.client.0.smithi073.stdout:================ 2024-09-10T07:50:22.338 INFO:tasks.workunit.client.0.smithi073.stdout: num_threads = 32 2024-09-10T07:50:22.338 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-10T07:50:22.339 INFO:tasks.workunit.client.0.smithi073.stdout: read_random = off 2024-09-10T07:50:22.339 INFO:tasks.workunit.client.0.smithi073.stdout: read_size = 0 (0B) 2024-09-10T07:50:22.339 INFO:tasks.workunit.client.0.smithi073.stdout: read_blocksize = 0 (0B) 2024-09-10T07:50:22.339 INFO:tasks.workunit.client.0.smithi073.stdout: read_skip = off 2024-09-10T07:50:22.339 INFO:tasks.workunit.client.0.smithi073.stdout: read_skipsize = 0 (0B) 2024-09-10T07:50:22.339 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-10T07:50:22.339 INFO:tasks.workunit.client.0.smithi073.stdout: write_random = on 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: write_size = 5242880 (5MB) 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: fsync_file = 0 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: write_blocksize = 4096 (4KB) 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: wait time = 0 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: op weights 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: read = 0 (0.00%) 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: readall = 0 (0.00%) 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: write = 1 (100.00%) 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: create = 0 (0.00%) 2024-09-10T07:50:22.340 INFO:tasks.workunit.client.0.smithi073.stdout: append = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: delete = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: metaop = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: createdir = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: stat = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: writeall = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: writeall_fsync = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: open_close = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: write_fsync = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: create_fsync = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: append_fsync = 0 (0.00%) 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout:FileSystem . 2024-09-10T07:50:22.341 INFO:tasks.workunit.client.0.smithi073.stdout:========== 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: num_dirs = 0 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: starting files = 128 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: min file size = 104857600 (100MB) 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: max file size = 104857600 (100MB) 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: directio = off 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: alignedio = on 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: bufferedio = off 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: aging is off 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: current utilization = 0.00% 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout:checking existing fs: . 2024-09-10T07:50:22.342 INFO:tasks.workunit.client.0.smithi073.stdout:recreating new fileset 2024-09-10T07:50:22.343 INFO:tasks.workunit.client.0.smithi073.stderr:opendir: No such file or directory 2024-09-10T07:50:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:22 smithi102 ceph-mon[35514]: pgmap v40: 97 pgs: 97 active+clean; 6.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 513 KiB/s wr, 55 op/s 2024-09-10T07:50:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:22 smithi159 ceph-mon[35522]: pgmap v40: 97 pgs: 97 active+clean; 6.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 513 KiB/s wr, 55 op/s 2024-09-10T07:50:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:22 smithi073 ceph-mon[30850]: pgmap v40: 97 pgs: 97 active+clean; 6.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 513 KiB/s wr, 55 op/s 2024-09-10T07:50:25.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:24 smithi102 ceph-mon[35514]: pgmap v41: 97 pgs: 97 active+clean; 112 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 9.3 MiB/s wr, 78 op/s 2024-09-10T07:50:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:24 smithi159 ceph-mon[35522]: pgmap v41: 97 pgs: 97 active+clean; 112 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 9.3 MiB/s wr, 78 op/s 2024-09-10T07:50:25.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:24 smithi073 ceph-mon[30850]: pgmap v41: 97 pgs: 97 active+clean; 112 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 9.3 MiB/s wr, 78 op/s 2024-09-10T07:50:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:25 smithi159 ceph-mon[35522]: pgmap v42: 97 pgs: 97 active+clean; 186 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 15 MiB/s wr, 112 op/s 2024-09-10T07:50:26.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:25 smithi073 ceph-mon[30850]: pgmap v42: 97 pgs: 97 active+clean; 186 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 15 MiB/s wr, 112 op/s 2024-09-10T07:50:26.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:25 smithi102 ceph-mon[35514]: pgmap v42: 97 pgs: 97 active+clean; 186 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 15 MiB/s wr, 112 op/s 2024-09-10T07:50:28.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:27 smithi073 ceph-mon[30850]: pgmap v43: 97 pgs: 97 active+clean; 186 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 15 MiB/s wr, 104 op/s 2024-09-10T07:50:28.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:27 smithi102 ceph-mon[35514]: pgmap v43: 97 pgs: 97 active+clean; 186 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 15 MiB/s wr, 104 op/s 2024-09-10T07:50:28.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:27 smithi159 ceph-mon[35522]: pgmap v43: 97 pgs: 97 active+clean; 186 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 15 MiB/s wr, 104 op/s 2024-09-10T07:50:30.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:29 smithi073 ceph-mon[30850]: pgmap v44: 97 pgs: 97 active+clean; 3.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 278 MiB/s wr, 208 op/s 2024-09-10T07:50:30.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:29 smithi102 ceph-mon[35514]: pgmap v44: 97 pgs: 97 active+clean; 3.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 278 MiB/s wr, 208 op/s 2024-09-10T07:50:30.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:29 smithi159 ceph-mon[35522]: pgmap v44: 97 pgs: 97 active+clean; 3.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 278 MiB/s wr, 208 op/s 2024-09-10T07:50:32.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:32 smithi102 ceph-mon[35514]: pgmap v45: 97 pgs: 97 active+clean; 3.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 278 MiB/s wr, 160 op/s 2024-09-10T07:50:32.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:32 smithi159 ceph-mon[35522]: pgmap v45: 97 pgs: 97 active+clean; 3.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 278 MiB/s wr, 160 op/s 2024-09-10T07:50:32.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:31 smithi073 ceph-mon[30850]: pgmap v45: 97 pgs: 97 active+clean; 3.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 278 MiB/s wr, 160 op/s 2024-09-10T07:50:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:34 smithi159 ceph-mon[35522]: pgmap v46: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 457 MiB/s wr, 207 op/s 2024-09-10T07:50:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:34 smithi073 ceph-mon[30850]: pgmap v46: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 457 MiB/s wr, 207 op/s 2024-09-10T07:50:35.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:34 smithi102 ceph-mon[35514]: pgmap v46: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 457 MiB/s wr, 207 op/s 2024-09-10T07:50:36.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:35 smithi159 ceph-mon[35522]: pgmap v47: 97 pgs: 97 active+clean; 6.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 551 MiB/s wr, 239 op/s 2024-09-10T07:50:36.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:35 smithi073 ceph-mon[30850]: pgmap v47: 97 pgs: 97 active+clean; 6.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 551 MiB/s wr, 239 op/s 2024-09-10T07:50:36.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:35 smithi102 ceph-mon[35514]: pgmap v47: 97 pgs: 97 active+clean; 6.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 551 MiB/s wr, 239 op/s 2024-09-10T07:50:38.290 INFO:tasks.workunit.client.0.smithi073.stdout:fs setup took 15 secs 2024-09-10T07:50:39.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:38 smithi073 ceph-mon[30850]: pgmap v48: 97 pgs: 97 active+clean; 6.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 545 MiB/s wr, 204 op/s 2024-09-10T07:50:39.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:38 smithi102 ceph-mon[35514]: pgmap v48: 97 pgs: 97 active+clean; 6.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 545 MiB/s wr, 204 op/s 2024-09-10T07:50:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:38 smithi159 ceph-mon[35522]: pgmap v48: 97 pgs: 97 active+clean; 6.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 545 MiB/s wr, 204 op/s 2024-09-10T07:50:40.625 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:40 smithi102 ceph-mon[35514]: pgmap v49: 97 pgs: 97 active+clean; 9.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 817 MiB/s wr, 303 op/s 2024-09-10T07:50:40.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:40 smithi159 ceph-mon[35522]: pgmap v49: 97 pgs: 97 active+clean; 9.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 817 MiB/s wr, 303 op/s 2024-09-10T07:50:40.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:40 smithi073 ceph-mon[30850]: pgmap v49: 97 pgs: 97 active+clean; 9.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 817 MiB/s wr, 303 op/s 2024-09-10T07:50:41.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:41 smithi102 ceph-mon[35514]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-10T07:50:41.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:41 smithi159 ceph-mon[35522]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-10T07:50:41.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:41 smithi073 ceph-mon[30850]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-10T07:50:41.885 INFO:tasks.workunit.client.0.smithi073.stdout:Syncing()...3 sec 2024-09-10T07:50:41.886 INFO:tasks.workunit.client.0.smithi073.stdout:Starting Actual Benchmark At: Tue Sep 10 07:50:41 2024 2024-09-10T07:50:41.886 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-10T07:50:42.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:42 smithi159 ceph-mon[35522]: pgmap v50: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 613 MiB/s wr, 214 op/s 2024-09-10T07:50:42.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:42 smithi073 ceph-mon[30850]: pgmap v50: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 613 MiB/s wr, 214 op/s 2024-09-10T07:50:42.875 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:42 smithi102 ceph-mon[35514]: pgmap v50: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 613 MiB/s wr, 214 op/s 2024-09-10T07:50:45.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:44 smithi102 ceph-mon[35514]: pgmap v51: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 613 MiB/s wr, 214 op/s 2024-09-10T07:50:45.156 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:44 smithi159 ceph-mon[35522]: pgmap v51: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 613 MiB/s wr, 214 op/s 2024-09-10T07:50:45.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:44 smithi073 ceph-mon[30850]: pgmap v51: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 613 MiB/s wr, 214 op/s 2024-09-10T07:50:47.129 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:46 smithi102 ceph-mon[35514]: pgmap v52: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 647 MiB/s wr, 6.19k op/s 2024-09-10T07:50:47.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:46 smithi159 ceph-mon[35522]: pgmap v52: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 647 MiB/s wr, 6.19k op/s 2024-09-10T07:50:47.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:46 smithi073 ceph-mon[30850]: pgmap v52: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 647 MiB/s wr, 6.19k op/s 2024-09-10T07:50:49.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:48 smithi159 ceph-mon[35522]: pgmap v53: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 544 MiB/s wr, 6.14k op/s 2024-09-10T07:50:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:48 smithi073 ceph-mon[30850]: pgmap v53: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 544 MiB/s wr, 6.14k op/s 2024-09-10T07:50:49.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:48 smithi102 ceph-mon[35514]: pgmap v53: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 544 MiB/s wr, 6.14k op/s 2024-09-10T07:50:50.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:49 smithi159 ceph-mon[35522]: pgmap v54: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 627 MiB/s wr, 17.11k op/s 2024-09-10T07:50:50.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:49 smithi073 ceph-mon[30850]: pgmap v54: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 627 MiB/s wr, 17.11k op/s 2024-09-10T07:50:50.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:49 smithi102 ceph-mon[35514]: pgmap v54: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 627 MiB/s wr, 17.11k op/s 2024-09-10T07:50:53.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:52 smithi102 ceph-mon[35514]: pgmap v55: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 382 MiB/s wr, 20.71k op/s 2024-09-10T07:50:53.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:52 smithi159 ceph-mon[35522]: pgmap v55: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 382 MiB/s wr, 20.71k op/s 2024-09-10T07:50:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:52 smithi073 ceph-mon[30850]: pgmap v55: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 382 MiB/s wr, 20.71k op/s 2024-09-10T07:50:55.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:54 smithi159 ceph-mon[35522]: pgmap v56: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 323 MiB/s wr, 20.70k op/s 2024-09-10T07:50:55.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:54 smithi073 ceph-mon[30850]: pgmap v56: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 323 MiB/s wr, 20.70k op/s 2024-09-10T07:50:55.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:54 smithi102 ceph-mon[35514]: pgmap v56: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 323 MiB/s wr, 20.70k op/s 2024-09-10T07:50:56.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:55 smithi159 ceph-mon[35522]: pgmap v57: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 464 MiB/s wr, 35.08k op/s 2024-09-10T07:50:56.226 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:55 smithi073 ceph-mon[30850]: pgmap v57: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 464 MiB/s wr, 35.08k op/s 2024-09-10T07:50:56.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:55 smithi102 ceph-mon[35514]: pgmap v57: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 464 MiB/s wr, 35.08k op/s 2024-09-10T07:50:59.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:50:58 smithi102 ceph-mon[35514]: pgmap v58: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 251 MiB/s wr, 29.05k op/s 2024-09-10T07:50:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:50:58 smithi159 ceph-mon[35522]: pgmap v58: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 251 MiB/s wr, 29.05k op/s 2024-09-10T07:50:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:50:58 smithi073 ceph-mon[30850]: pgmap v58: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 251 MiB/s wr, 29.05k op/s 2024-09-10T07:51:01.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:00 smithi159 ceph-mon[35522]: pgmap v59: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 363 MiB/s wr, 38.27k op/s 2024-09-10T07:51:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:00 smithi073 ceph-mon[30850]: pgmap v59: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 363 MiB/s wr, 38.27k op/s 2024-09-10T07:51:01.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:00 smithi102 ceph-mon[35514]: pgmap v59: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 363 MiB/s wr, 38.27k op/s 2024-09-10T07:51:02.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:01 smithi073 ceph-mon[30850]: pgmap v60: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 857 KiB/s rd, 332 MiB/s wr, 31.70k op/s 2024-09-10T07:51:02.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:01 smithi102 ceph-mon[35514]: pgmap v60: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 857 KiB/s rd, 332 MiB/s wr, 31.70k op/s 2024-09-10T07:51:02.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:01 smithi159 ceph-mon[35522]: pgmap v60: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 857 KiB/s rd, 332 MiB/s wr, 31.70k op/s 2024-09-10T07:51:05.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:04 smithi102 ceph-mon[35514]: pgmap v61: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 857 KiB/s rd, 305 MiB/s wr, 28.00k op/s 2024-09-10T07:51:05.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:04 smithi159 ceph-mon[35522]: pgmap v61: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 857 KiB/s rd, 305 MiB/s wr, 28.00k op/s 2024-09-10T07:51:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:04 smithi073 ceph-mon[30850]: pgmap v61: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 857 KiB/s rd, 305 MiB/s wr, 28.00k op/s 2024-09-10T07:51:07.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:06 smithi073 ceph-mon[30850]: pgmap v62: 97 pgs: 97 active+clean; 13 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 455 MiB/s wr, 39.30k op/s 2024-09-10T07:51:07.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:06 smithi102 ceph-mon[35514]: pgmap v62: 97 pgs: 97 active+clean; 13 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 455 MiB/s wr, 39.30k op/s 2024-09-10T07:51:07.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:06 smithi159 ceph-mon[35522]: pgmap v62: 97 pgs: 97 active+clean; 13 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 455 MiB/s wr, 39.30k op/s 2024-09-10T07:51:08.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:07 smithi073 ceph-mon[30850]: pgmap v63: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 649 KiB/s rd, 340 MiB/s wr, 27.00k op/s 2024-09-10T07:51:08.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:07 smithi102 ceph-mon[35514]: pgmap v63: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 649 KiB/s rd, 340 MiB/s wr, 27.00k op/s 2024-09-10T07:51:08.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:07 smithi159 ceph-mon[35522]: pgmap v63: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 649 KiB/s rd, 340 MiB/s wr, 27.00k op/s 2024-09-10T07:51:11.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:10 smithi102 ceph-mon[35514]: pgmap v64: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 745 KiB/s rd, 415 MiB/s wr, 34.26k op/s 2024-09-10T07:51:11.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:10 smithi159 ceph-mon[35522]: pgmap v64: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 745 KiB/s rd, 415 MiB/s wr, 34.26k op/s 2024-09-10T07:51:11.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:10 smithi073 ceph-mon[30850]: pgmap v64: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 745 KiB/s rd, 415 MiB/s wr, 34.26k op/s 2024-09-10T07:51:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:12 smithi159 ceph-mon[35522]: pgmap v65: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 438 KiB/s rd, 337 MiB/s wr, 28.64k op/s 2024-09-10T07:51:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:12 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:51:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:12 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:12 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:13.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:12 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:12 smithi073 ceph-mon[30850]: pgmap v65: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 438 KiB/s rd, 337 MiB/s wr, 28.64k op/s 2024-09-10T07:51:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:12 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:51:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:12 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:12 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:12 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:13.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:12 smithi102 ceph-mon[35514]: pgmap v65: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 438 KiB/s rd, 337 MiB/s wr, 28.64k op/s 2024-09-10T07:51:13.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:12 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:51:13.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:12 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:13.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:12 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:13.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:12 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:13 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:13 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:13 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:13 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:51:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:13 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:51:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:13 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:13 smithi159 ceph-mon[35522]: pgmap v66: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 437 KiB/s rd, 284 MiB/s wr, 24.25k op/s 2024-09-10T07:51:14.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:13 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:13 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:13 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:13 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:51:14.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:13 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:51:14.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:13 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:13 smithi073 ceph-mon[30850]: pgmap v66: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 437 KiB/s rd, 284 MiB/s wr, 24.25k op/s 2024-09-10T07:51:14.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:13 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:13 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:13 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:13 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:51:14.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:13 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:51:14.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:13 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:51:14.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:13 smithi102 ceph-mon[35514]: pgmap v66: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 437 KiB/s rd, 284 MiB/s wr, 24.25k op/s 2024-09-10T07:51:17.125 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:16 smithi102 ceph-mon[35514]: pgmap v67: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 459 KiB/s rd, 334 MiB/s wr, 31.41k op/s 2024-09-10T07:51:17.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:16 smithi159 ceph-mon[35522]: pgmap v67: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 459 KiB/s rd, 334 MiB/s wr, 31.41k op/s 2024-09-10T07:51:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:16 smithi073 ceph-mon[30850]: pgmap v67: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 459 KiB/s rd, 334 MiB/s wr, 31.41k op/s 2024-09-10T07:51:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:18 smithi102 ceph-mon[35514]: pgmap v68: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 118 KiB/s rd, 192 MiB/s wr, 21.41k op/s 2024-09-10T07:51:19.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:18 smithi159 ceph-mon[35522]: pgmap v68: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 118 KiB/s rd, 192 MiB/s wr, 21.41k op/s 2024-09-10T07:51:19.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:18 smithi073 ceph-mon[30850]: pgmap v68: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 118 KiB/s rd, 192 MiB/s wr, 21.41k op/s 2024-09-10T07:51:21.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:20 smithi102 ceph-mon[35514]: pgmap v69: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 149 KiB/s rd, 188 MiB/s wr, 23.80k op/s 2024-09-10T07:51:21.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:20 smithi159 ceph-mon[35522]: pgmap v69: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 149 KiB/s rd, 188 MiB/s wr, 23.80k op/s 2024-09-10T07:51:21.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:20 smithi073 ceph-mon[30850]: pgmap v69: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 149 KiB/s rd, 188 MiB/s wr, 23.80k op/s 2024-09-10T07:51:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:22 smithi159 ceph-mon[35522]: pgmap v70: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 53 KiB/s rd, 121 MiB/s wr, 17.99k op/s 2024-09-10T07:51:23.445 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:22 smithi102 ceph-mon[35514]: pgmap v70: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 53 KiB/s rd, 121 MiB/s wr, 17.99k op/s 2024-09-10T07:51:23.445 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:22 smithi073 ceph-mon[30850]: pgmap v70: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 53 KiB/s rd, 121 MiB/s wr, 17.99k op/s 2024-09-10T07:51:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:24 smithi159 ceph-mon[35522]: pgmap v71: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 53 KiB/s rd, 87 MiB/s wr, 14.38k op/s 2024-09-10T07:51:25.177 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:24 smithi102 ceph-mon[35514]: pgmap v71: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 53 KiB/s rd, 87 MiB/s wr, 14.38k op/s 2024-09-10T07:51:25.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:24 smithi073 ceph-mon[30850]: pgmap v71: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 53 KiB/s rd, 87 MiB/s wr, 14.38k op/s 2024-09-10T07:51:26.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:25 smithi159 ceph-mon[35522]: pgmap v72: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 68 KiB/s rd, 134 MiB/s wr, 21.65k op/s 2024-09-10T07:51:26.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:25 smithi073 ceph-mon[30850]: pgmap v72: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 68 KiB/s rd, 134 MiB/s wr, 21.65k op/s 2024-09-10T07:51:26.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:25 smithi102 ceph-mon[35514]: pgmap v72: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 68 KiB/s rd, 134 MiB/s wr, 21.65k op/s 2024-09-10T07:51:29.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:28 smithi102 ceph-mon[35514]: pgmap v73: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 46 KiB/s rd, 90 MiB/s wr, 15.46k op/s 2024-09-10T07:51:29.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:28 smithi159 ceph-mon[35522]: pgmap v73: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 46 KiB/s rd, 90 MiB/s wr, 15.46k op/s 2024-09-10T07:51:29.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:28 smithi073 ceph-mon[30850]: pgmap v73: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 46 KiB/s rd, 90 MiB/s wr, 15.46k op/s 2024-09-10T07:51:31.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:30 smithi102 ceph-mon[35514]: pgmap v74: 97 pgs: 97 active+clean; 13 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 79 KiB/s rd, 109 MiB/s wr, 19.13k op/s 2024-09-10T07:51:31.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:30 smithi159 ceph-mon[35522]: pgmap v74: 97 pgs: 97 active+clean; 13 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 79 KiB/s rd, 109 MiB/s wr, 19.13k op/s 2024-09-10T07:51:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:30 smithi073 ceph-mon[30850]: pgmap v74: 97 pgs: 97 active+clean; 13 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 79 KiB/s rd, 109 MiB/s wr, 19.13k op/s 2024-09-10T07:51:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:32 smithi159 ceph-mon[35522]: pgmap v75: 97 pgs: 97 active+clean; 13 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 48 KiB/s rd, 95 MiB/s wr, 16.20k op/s 2024-09-10T07:51:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:32 smithi073 ceph-mon[30850]: pgmap v75: 97 pgs: 97 active+clean; 13 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 48 KiB/s rd, 95 MiB/s wr, 16.20k op/s 2024-09-10T07:51:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:32 smithi102 ceph-mon[35514]: pgmap v75: 97 pgs: 97 active+clean; 13 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 48 KiB/s rd, 95 MiB/s wr, 16.20k op/s 2024-09-10T07:51:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:34 smithi159 ceph-mon[35522]: pgmap v76: 97 pgs: 97 active+clean; 13 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 48 KiB/s rd, 87 MiB/s wr, 14.76k op/s 2024-09-10T07:51:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:34 smithi073 ceph-mon[30850]: pgmap v76: 97 pgs: 97 active+clean; 13 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 48 KiB/s rd, 87 MiB/s wr, 14.76k op/s 2024-09-10T07:51:35.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:34 smithi102 ceph-mon[35514]: pgmap v76: 97 pgs: 97 active+clean; 13 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 48 KiB/s rd, 87 MiB/s wr, 14.76k op/s 2024-09-10T07:51:36.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:35 smithi159 ceph-mon[35522]: pgmap v77: 97 pgs: 97 active+clean; 13 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 57 KiB/s rd, 128 MiB/s wr, 21.43k op/s 2024-09-10T07:51:36.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:35 smithi073 ceph-mon[30850]: pgmap v77: 97 pgs: 97 active+clean; 13 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 57 KiB/s rd, 128 MiB/s wr, 21.43k op/s 2024-09-10T07:51:36.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:35 smithi102 ceph-mon[35514]: pgmap v77: 97 pgs: 97 active+clean; 13 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 57 KiB/s rd, 128 MiB/s wr, 21.43k op/s 2024-09-10T07:51:39.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:38 smithi159 ceph-mon[35522]: pgmap v78: 97 pgs: 97 active+clean; 13 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 42 KiB/s rd, 89 MiB/s wr, 15.46k op/s 2024-09-10T07:51:39.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:38 smithi073 ceph-mon[30850]: pgmap v78: 97 pgs: 97 active+clean; 13 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 42 KiB/s rd, 89 MiB/s wr, 15.46k op/s 2024-09-10T07:51:39.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:38 smithi102 ceph-mon[35514]: pgmap v78: 97 pgs: 97 active+clean; 13 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 42 KiB/s rd, 89 MiB/s wr, 15.46k op/s 2024-09-10T07:51:40.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:39 smithi159 ceph-mon[35522]: pgmap v79: 97 pgs: 97 active+clean; 13 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 72 KiB/s rd, 113 MiB/s wr, 19.83k op/s 2024-09-10T07:51:40.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:39 smithi073 ceph-mon[30850]: pgmap v79: 97 pgs: 97 active+clean; 13 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 72 KiB/s rd, 113 MiB/s wr, 19.83k op/s 2024-09-10T07:51:40.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:39 smithi102 ceph-mon[35514]: pgmap v79: 97 pgs: 97 active+clean; 13 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 72 KiB/s rd, 113 MiB/s wr, 19.83k op/s 2024-09-10T07:51:43.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:42 smithi159 ceph-mon[35522]: pgmap v80: 97 pgs: 97 active+clean; 13 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 39 KiB/s rd, 99 MiB/s wr, 17.11k op/s 2024-09-10T07:51:43.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:42 smithi073 ceph-mon[30850]: pgmap v80: 97 pgs: 97 active+clean; 13 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 39 KiB/s rd, 99 MiB/s wr, 17.11k op/s 2024-09-10T07:51:43.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:42 smithi102 ceph-mon[35514]: pgmap v80: 97 pgs: 97 active+clean; 13 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 39 KiB/s rd, 99 MiB/s wr, 17.11k op/s 2024-09-10T07:51:45.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:44 smithi159 ceph-mon[35522]: pgmap v81: 97 pgs: 97 active+clean; 13 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 39 KiB/s rd, 90 MiB/s wr, 15.57k op/s 2024-09-10T07:51:45.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:44 smithi073 ceph-mon[30850]: pgmap v81: 97 pgs: 97 active+clean; 13 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 39 KiB/s rd, 90 MiB/s wr, 15.57k op/s 2024-09-10T07:51:45.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:44 smithi102 ceph-mon[35514]: pgmap v81: 97 pgs: 97 active+clean; 13 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 39 KiB/s rd, 90 MiB/s wr, 15.57k op/s 2024-09-10T07:51:46.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:45 smithi073 ceph-mon[30850]: pgmap v82: 97 pgs: 97 active+clean; 14 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 82 KiB/s rd, 128 MiB/s wr, 22.65k op/s 2024-09-10T07:51:46.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:45 smithi102 ceph-mon[35514]: pgmap v82: 97 pgs: 97 active+clean; 14 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 82 KiB/s rd, 128 MiB/s wr, 22.65k op/s 2024-09-10T07:51:46.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:45 smithi159 ceph-mon[35522]: pgmap v82: 97 pgs: 97 active+clean; 14 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 82 KiB/s rd, 128 MiB/s wr, 22.65k op/s 2024-09-10T07:51:49.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:48 smithi159 ceph-mon[35522]: pgmap v83: 97 pgs: 97 active+clean; 14 GiB data, 73 GiB used, 999 GiB / 1.0 TiB avail; 72 KiB/s rd, 96 MiB/s wr, 17.47k op/s 2024-09-10T07:51:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:48 smithi073 ceph-mon[30850]: pgmap v83: 97 pgs: 97 active+clean; 14 GiB data, 73 GiB used, 999 GiB / 1.0 TiB avail; 72 KiB/s rd, 96 MiB/s wr, 17.47k op/s 2024-09-10T07:51:49.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:48 smithi102 ceph-mon[35514]: pgmap v83: 97 pgs: 97 active+clean; 14 GiB data, 73 GiB used, 999 GiB / 1.0 TiB avail; 72 KiB/s rd, 96 MiB/s wr, 17.47k op/s 2024-09-10T07:51:51.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:50 smithi159 ceph-mon[35522]: pgmap v84: 97 pgs: 97 active+clean; 14 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 72 KiB/s rd, 114 MiB/s wr, 21.12k op/s 2024-09-10T07:51:51.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:50 smithi073 ceph-mon[30850]: pgmap v84: 97 pgs: 97 active+clean; 14 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 72 KiB/s rd, 114 MiB/s wr, 21.12k op/s 2024-09-10T07:51:51.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:50 smithi102 ceph-mon[35514]: pgmap v84: 97 pgs: 97 active+clean; 14 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 72 KiB/s rd, 114 MiB/s wr, 21.12k op/s 2024-09-10T07:51:52.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:51 smithi073 ceph-mon[30850]: pgmap v85: 97 pgs: 97 active+clean; 14 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 43 KiB/s rd, 105 MiB/s wr, 19.43k op/s 2024-09-10T07:51:52.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:51 smithi102 ceph-mon[35514]: pgmap v85: 97 pgs: 97 active+clean; 14 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 43 KiB/s rd, 105 MiB/s wr, 19.43k op/s 2024-09-10T07:51:52.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:51 smithi159 ceph-mon[35522]: pgmap v85: 97 pgs: 97 active+clean; 14 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 43 KiB/s rd, 105 MiB/s wr, 19.43k op/s 2024-09-10T07:51:55.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:54 smithi159 ceph-mon[35522]: pgmap v86: 97 pgs: 97 active+clean; 14 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 43 KiB/s rd, 101 MiB/s wr, 18.65k op/s 2024-09-10T07:51:55.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:54 smithi073 ceph-mon[30850]: pgmap v86: 97 pgs: 97 active+clean; 14 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 43 KiB/s rd, 101 MiB/s wr, 18.65k op/s 2024-09-10T07:51:55.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:54 smithi102 ceph-mon[35514]: pgmap v86: 97 pgs: 97 active+clean; 14 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 43 KiB/s rd, 101 MiB/s wr, 18.65k op/s 2024-09-10T07:51:56.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:55 smithi159 ceph-mon[35522]: pgmap v87: 97 pgs: 97 active+clean; 15 GiB data, 77 GiB used, 995 GiB / 1.0 TiB avail; 270 KiB/s rd, 149 MiB/s wr, 26.66k op/s 2024-09-10T07:51:56.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:55 smithi073 ceph-mon[30850]: pgmap v87: 97 pgs: 97 active+clean; 15 GiB data, 77 GiB used, 995 GiB / 1.0 TiB avail; 270 KiB/s rd, 149 MiB/s wr, 26.66k op/s 2024-09-10T07:51:56.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:55 smithi102 ceph-mon[35514]: pgmap v87: 97 pgs: 97 active+clean; 15 GiB data, 77 GiB used, 995 GiB / 1.0 TiB avail; 270 KiB/s rd, 149 MiB/s wr, 26.66k op/s 2024-09-10T07:51:59.158 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:58 smithi159 ceph-mon[35522]: pgmap v88: 97 pgs: 97 active+clean; 15 GiB data, 78 GiB used, 995 GiB / 1.0 TiB avail; 228 KiB/s rd, 127 MiB/s wr, 22.05k op/s 2024-09-10T07:51:59.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:58 smithi073 ceph-mon[30850]: pgmap v88: 97 pgs: 97 active+clean; 15 GiB data, 78 GiB used, 995 GiB / 1.0 TiB avail; 228 KiB/s rd, 127 MiB/s wr, 22.05k op/s 2024-09-10T07:51:59.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:58 smithi102 ceph-mon[35514]: pgmap v88: 97 pgs: 97 active+clean; 15 GiB data, 78 GiB used, 995 GiB / 1.0 TiB avail; 228 KiB/s rd, 127 MiB/s wr, 22.05k op/s 2024-09-10T07:52:00.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:51:59 smithi073 ceph-mon[30850]: pgmap v89: 97 pgs: 97 active+clean; 15 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 329 KiB/s rd, 147 MiB/s wr, 25.28k op/s 2024-09-10T07:52:00.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:51:59 smithi102 ceph-mon[35514]: pgmap v89: 97 pgs: 97 active+clean; 15 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 329 KiB/s rd, 147 MiB/s wr, 25.28k op/s 2024-09-10T07:52:00.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:51:59 smithi159 ceph-mon[35522]: pgmap v89: 97 pgs: 97 active+clean; 15 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 329 KiB/s rd, 147 MiB/s wr, 25.28k op/s 2024-09-10T07:52:03.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:02 smithi159 ceph-mon[35522]: pgmap v90: 97 pgs: 97 active+clean; 16 GiB data, 80 GiB used, 992 GiB / 1.0 TiB avail; 328 KiB/s rd, 144 MiB/s wr, 24.35k op/s 2024-09-10T07:52:03.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:02 smithi073 ceph-mon[30850]: pgmap v90: 97 pgs: 97 active+clean; 16 GiB data, 80 GiB used, 992 GiB / 1.0 TiB avail; 328 KiB/s rd, 144 MiB/s wr, 24.35k op/s 2024-09-10T07:52:03.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:02 smithi102 ceph-mon[35514]: pgmap v90: 97 pgs: 97 active+clean; 16 GiB data, 80 GiB used, 992 GiB / 1.0 TiB avail; 328 KiB/s rd, 144 MiB/s wr, 24.35k op/s 2024-09-10T07:52:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:03 smithi073 ceph-mon[30850]: pgmap v91: 97 pgs: 97 active+clean; 16 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 329 KiB/s rd, 134 MiB/s wr, 22.25k op/s 2024-09-10T07:52:04.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:03 smithi102 ceph-mon[35514]: pgmap v91: 97 pgs: 97 active+clean; 16 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 329 KiB/s rd, 134 MiB/s wr, 22.25k op/s 2024-09-10T07:52:04.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:03 smithi159 ceph-mon[35522]: pgmap v91: 97 pgs: 97 active+clean; 16 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 329 KiB/s rd, 134 MiB/s wr, 22.25k op/s 2024-09-10T07:52:07.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:06 smithi159 ceph-mon[35522]: pgmap v92: 97 pgs: 97 active+clean; 16 GiB data, 82 GiB used, 990 GiB / 1.0 TiB avail; 462 KiB/s rd, 159 MiB/s wr, 25.75k op/s 2024-09-10T07:52:07.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:06 smithi073 ceph-mon[30850]: pgmap v92: 97 pgs: 97 active+clean; 16 GiB data, 82 GiB used, 990 GiB / 1.0 TiB avail; 462 KiB/s rd, 159 MiB/s wr, 25.75k op/s 2024-09-10T07:52:07.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:06 smithi102 ceph-mon[35514]: pgmap v92: 97 pgs: 97 active+clean; 16 GiB data, 82 GiB used, 990 GiB / 1.0 TiB avail; 462 KiB/s rd, 159 MiB/s wr, 25.75k op/s 2024-09-10T07:52:09.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:08 smithi159 ceph-mon[35522]: pgmap v93: 97 pgs: 97 active+clean; 16 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 235 KiB/s rd, 134 MiB/s wr, 21.28k op/s 2024-09-10T07:52:09.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:08 smithi073 ceph-mon[30850]: pgmap v93: 97 pgs: 97 active+clean; 16 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 235 KiB/s rd, 134 MiB/s wr, 21.28k op/s 2024-09-10T07:52:09.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:08 smithi102 ceph-mon[35514]: pgmap v93: 97 pgs: 97 active+clean; 16 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 235 KiB/s rd, 134 MiB/s wr, 21.28k op/s 2024-09-10T07:52:11.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:10 smithi159 ceph-mon[35522]: pgmap v94: 97 pgs: 97 active+clean; 16 GiB data, 84 GiB used, 989 GiB / 1.0 TiB avail; 236 KiB/s rd, 132 MiB/s wr, 20.82k op/s 2024-09-10T07:52:11.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:10 smithi073 ceph-mon[30850]: pgmap v94: 97 pgs: 97 active+clean; 16 GiB data, 84 GiB used, 989 GiB / 1.0 TiB avail; 236 KiB/s rd, 132 MiB/s wr, 20.82k op/s 2024-09-10T07:52:11.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:10 smithi102 ceph-mon[35514]: pgmap v94: 97 pgs: 97 active+clean; 16 GiB data, 84 GiB used, 989 GiB / 1.0 TiB avail; 236 KiB/s rd, 132 MiB/s wr, 20.82k op/s 2024-09-10T07:52:12.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:11 smithi073 ceph-mon[30850]: pgmap v95: 97 pgs: 97 active+clean; 16 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 195 KiB/s rd, 119 MiB/s wr, 18.51k op/s 2024-09-10T07:52:12.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:11 smithi102 ceph-mon[35514]: pgmap v95: 97 pgs: 97 active+clean; 16 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 195 KiB/s rd, 119 MiB/s wr, 18.51k op/s 2024-09-10T07:52:12.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:11 smithi159 ceph-mon[35522]: pgmap v95: 97 pgs: 97 active+clean; 16 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 195 KiB/s rd, 119 MiB/s wr, 18.51k op/s 2024-09-10T07:52:15.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:14 smithi159 ceph-mon[35522]: pgmap v96: 97 pgs: 97 active+clean; 17 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 195 KiB/s rd, 98 MiB/s wr, 15.02k op/s 2024-09-10T07:52:15.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:14 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:52:15.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:14 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:52:15.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:14 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:52:15.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:14 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:52:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:14 smithi073 ceph-mon[30850]: pgmap v96: 97 pgs: 97 active+clean; 17 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 195 KiB/s rd, 98 MiB/s wr, 15.02k op/s 2024-09-10T07:52:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:14 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:52:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:14 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:52:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:14 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:52:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:14 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:52:15.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:14 smithi102 ceph-mon[35514]: pgmap v96: 97 pgs: 97 active+clean; 17 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 195 KiB/s rd, 98 MiB/s wr, 15.02k op/s 2024-09-10T07:52:15.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:14 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:52:15.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:14 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:52:15.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:14 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:52:15.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:14 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:52:17.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:16 smithi159 ceph-mon[35522]: pgmap v97: 97 pgs: 97 active+clean; 17 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 195 KiB/s rd, 105 MiB/s wr, 16.64k op/s 2024-09-10T07:52:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:16 smithi073 ceph-mon[30850]: pgmap v97: 97 pgs: 97 active+clean; 17 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 195 KiB/s rd, 105 MiB/s wr, 16.64k op/s 2024-09-10T07:52:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:16 smithi102 ceph-mon[35514]: pgmap v97: 97 pgs: 97 active+clean; 17 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 195 KiB/s rd, 105 MiB/s wr, 16.64k op/s 2024-09-10T07:52:19.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:18 smithi073 ceph-mon[30850]: pgmap v98: 97 pgs: 97 active+clean; 17 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 79 KiB/s rd, 83 MiB/s wr, 13.84k op/s 2024-09-10T07:52:19.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:18 smithi102 ceph-mon[35514]: pgmap v98: 97 pgs: 97 active+clean; 17 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 79 KiB/s rd, 83 MiB/s wr, 13.84k op/s 2024-09-10T07:52:19.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:18 smithi159 ceph-mon[35522]: pgmap v98: 97 pgs: 97 active+clean; 17 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 79 KiB/s rd, 83 MiB/s wr, 13.84k op/s 2024-09-10T07:52:20.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:19 smithi073 ceph-mon[30850]: pgmap v99: 97 pgs: 97 active+clean; 17 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 79 KiB/s rd, 69 MiB/s wr, 12.12k op/s 2024-09-10T07:52:20.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:19 smithi159 ceph-mon[35522]: pgmap v99: 97 pgs: 97 active+clean; 17 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 79 KiB/s rd, 69 MiB/s wr, 12.12k op/s 2024-09-10T07:52:20.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:19 smithi102 ceph-mon[35514]: pgmap v99: 97 pgs: 97 active+clean; 17 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 79 KiB/s rd, 69 MiB/s wr, 12.12k op/s 2024-09-10T07:52:23.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:22 smithi159 ceph-mon[35522]: pgmap v100: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 93 KiB/s rd, 93 MiB/s wr, 16.49k op/s 2024-09-10T07:52:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:22 smithi073 ceph-mon[30850]: pgmap v100: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 93 KiB/s rd, 93 MiB/s wr, 16.49k op/s 2024-09-10T07:52:23.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:22 smithi102 ceph-mon[35514]: pgmap v100: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 93 KiB/s rd, 93 MiB/s wr, 16.49k op/s 2024-09-10T07:52:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:24 smithi159 ceph-mon[35522]: pgmap v101: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 33 KiB/s rd, 78 MiB/s wr, 14.08k op/s 2024-09-10T07:52:25.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:24 smithi102 ceph-mon[35514]: pgmap v101: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 33 KiB/s rd, 78 MiB/s wr, 14.08k op/s 2024-09-10T07:52:25.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:24 smithi073 ceph-mon[30850]: pgmap v101: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 33 KiB/s rd, 78 MiB/s wr, 14.08k op/s 2024-09-10T07:52:27.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:26 smithi159 ceph-mon[35522]: pgmap v102: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 33 KiB/s rd, 102 MiB/s wr, 18.72k op/s 2024-09-10T07:52:27.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:26 smithi073 ceph-mon[30850]: pgmap v102: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 33 KiB/s rd, 102 MiB/s wr, 18.72k op/s 2024-09-10T07:52:27.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:26 smithi102 ceph-mon[35514]: pgmap v102: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 33 KiB/s rd, 102 MiB/s wr, 18.72k op/s 2024-09-10T07:52:28.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:27 smithi073 ceph-mon[30850]: pgmap v103: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 66 KiB/s rd, 96 MiB/s wr, 17.66k op/s 2024-09-10T07:52:28.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:27 smithi102 ceph-mon[35514]: pgmap v103: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 66 KiB/s rd, 96 MiB/s wr, 17.66k op/s 2024-09-10T07:52:28.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:27 smithi159 ceph-mon[35522]: pgmap v103: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 66 KiB/s rd, 96 MiB/s wr, 17.66k op/s 2024-09-10T07:52:31.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:30 smithi159 ceph-mon[35522]: pgmap v104: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 49 KiB/s rd, 89 MiB/s wr, 16.36k op/s 2024-09-10T07:52:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:30 smithi073 ceph-mon[30850]: pgmap v104: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 49 KiB/s rd, 89 MiB/s wr, 16.36k op/s 2024-09-10T07:52:31.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:30 smithi102 ceph-mon[35514]: pgmap v104: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 49 KiB/s rd, 89 MiB/s wr, 16.36k op/s 2024-09-10T07:52:33.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:32 smithi159 ceph-mon[35522]: pgmap v105: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 80 KiB/s rd, 97 MiB/s wr, 17.95k op/s 2024-09-10T07:52:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:32 smithi073 ceph-mon[30850]: pgmap v105: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 80 KiB/s rd, 97 MiB/s wr, 17.95k op/s 2024-09-10T07:52:33.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:32 smithi102 ceph-mon[35514]: pgmap v105: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 80 KiB/s rd, 97 MiB/s wr, 17.95k op/s 2024-09-10T07:52:35.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:34 smithi159 ceph-mon[35522]: pgmap v106: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 65 KiB/s rd, 60 MiB/s wr, 11.55k op/s 2024-09-10T07:52:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:34 smithi073 ceph-mon[30850]: pgmap v106: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 65 KiB/s rd, 60 MiB/s wr, 11.55k op/s 2024-09-10T07:52:35.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:34 smithi102 ceph-mon[35514]: pgmap v106: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 65 KiB/s rd, 60 MiB/s wr, 11.55k op/s 2024-09-10T07:52:37.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:36 smithi159 ceph-mon[35522]: pgmap v107: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 65 KiB/s rd, 74 MiB/s wr, 13.88k op/s 2024-09-10T07:52:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:36 smithi073 ceph-mon[30850]: pgmap v107: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 65 KiB/s rd, 74 MiB/s wr, 13.88k op/s 2024-09-10T07:52:37.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:36 smithi102 ceph-mon[35514]: pgmap v107: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 65 KiB/s rd, 74 MiB/s wr, 13.88k op/s 2024-09-10T07:52:39.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:38 smithi159 ceph-mon[35522]: pgmap v108: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 981 GiB / 1.0 TiB avail; 87 KiB/s rd, 53 MiB/s wr, 9.83k op/s 2024-09-10T07:52:39.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:38 smithi073 ceph-mon[30850]: pgmap v108: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 981 GiB / 1.0 TiB avail; 87 KiB/s rd, 53 MiB/s wr, 9.83k op/s 2024-09-10T07:52:39.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:38 smithi102 ceph-mon[35514]: pgmap v108: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 981 GiB / 1.0 TiB avail; 87 KiB/s rd, 53 MiB/s wr, 9.83k op/s 2024-09-10T07:52:40.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:39 smithi073 ceph-mon[30850]: pgmap v109: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 54 KiB/s rd, 46 MiB/s wr, 8.53k op/s 2024-09-10T07:52:40.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:39 smithi102 ceph-mon[35514]: pgmap v109: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 54 KiB/s rd, 46 MiB/s wr, 8.53k op/s 2024-09-10T07:52:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:39 smithi159 ceph-mon[35522]: pgmap v109: 97 pgs: 97 active+clean; 18 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 54 KiB/s rd, 46 MiB/s wr, 8.53k op/s 2024-09-10T07:52:43.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:42 smithi159 ceph-mon[35522]: pgmap v110: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 75 KiB/s rd, 63 MiB/s wr, 12.02k op/s 2024-09-10T07:52:43.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:42 smithi073 ceph-mon[30850]: pgmap v110: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 75 KiB/s rd, 63 MiB/s wr, 12.02k op/s 2024-09-10T07:52:43.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:42 smithi102 ceph-mon[35514]: pgmap v110: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 75 KiB/s rd, 63 MiB/s wr, 12.02k op/s 2024-09-10T07:52:45.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:44 smithi159 ceph-mon[35522]: pgmap v111: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 43 KiB/s rd, 45 MiB/s wr, 8.61k op/s 2024-09-10T07:52:45.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:44 smithi073 ceph-mon[30850]: pgmap v111: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 43 KiB/s rd, 45 MiB/s wr, 8.61k op/s 2024-09-10T07:52:45.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:44 smithi102 ceph-mon[35514]: pgmap v111: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 43 KiB/s rd, 45 MiB/s wr, 8.61k op/s 2024-09-10T07:52:47.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:46 smithi073 ceph-mon[30850]: pgmap v112: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 43 KiB/s rd, 61 MiB/s wr, 11.67k op/s 2024-09-10T07:52:47.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:46 smithi102 ceph-mon[35514]: pgmap v112: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 43 KiB/s rd, 61 MiB/s wr, 11.67k op/s 2024-09-10T07:52:47.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:46 smithi159 ceph-mon[35522]: pgmap v112: 97 pgs: 97 active+clean; 18 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 43 KiB/s rd, 61 MiB/s wr, 11.67k op/s 2024-09-10T07:52:48.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:47 smithi073 ceph-mon[30850]: pgmap v113: 97 pgs: 97 active+clean; 19 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 86 KiB/s rd, 54 MiB/s wr, 10.72k op/s 2024-09-10T07:52:48.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:47 smithi102 ceph-mon[35514]: pgmap v113: 97 pgs: 97 active+clean; 19 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 86 KiB/s rd, 54 MiB/s wr, 10.72k op/s 2024-09-10T07:52:48.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:47 smithi159 ceph-mon[35522]: pgmap v113: 97 pgs: 97 active+clean; 19 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 86 KiB/s rd, 54 MiB/s wr, 10.72k op/s 2024-09-10T07:52:51.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:50 smithi159 ceph-mon[35522]: pgmap v114: 97 pgs: 97 active+clean; 19 GiB data, 89 GiB used, 983 GiB / 1.0 TiB avail; 64 KiB/s rd, 51 MiB/s wr, 10.15k op/s 2024-09-10T07:52:51.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:50 smithi073 ceph-mon[30850]: pgmap v114: 97 pgs: 97 active+clean; 19 GiB data, 89 GiB used, 983 GiB / 1.0 TiB avail; 64 KiB/s rd, 51 MiB/s wr, 10.15k op/s 2024-09-10T07:52:51.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:50 smithi102 ceph-mon[35514]: pgmap v114: 97 pgs: 97 active+clean; 19 GiB data, 89 GiB used, 983 GiB / 1.0 TiB avail; 64 KiB/s rd, 51 MiB/s wr, 10.15k op/s 2024-09-10T07:52:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:52 smithi073 ceph-mon[30850]: pgmap v115: 97 pgs: 97 active+clean; 19 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 87 KiB/s rd, 74 MiB/s wr, 14.51k op/s 2024-09-10T07:52:53.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:52 smithi102 ceph-mon[35514]: pgmap v115: 97 pgs: 97 active+clean; 19 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 87 KiB/s rd, 74 MiB/s wr, 14.51k op/s 2024-09-10T07:52:53.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:52 smithi159 ceph-mon[35522]: pgmap v115: 97 pgs: 97 active+clean; 19 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 87 KiB/s rd, 74 MiB/s wr, 14.51k op/s 2024-09-10T07:52:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:53 smithi073 ceph-mon[30850]: pgmap v116: 97 pgs: 97 active+clean; 19 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 66 KiB/s rd, 53 MiB/s wr, 10.14k op/s 2024-09-10T07:52:54.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:53 smithi102 ceph-mon[35514]: pgmap v116: 97 pgs: 97 active+clean; 19 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 66 KiB/s rd, 53 MiB/s wr, 10.14k op/s 2024-09-10T07:52:54.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:53 smithi159 ceph-mon[35522]: pgmap v116: 97 pgs: 97 active+clean; 19 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 66 KiB/s rd, 53 MiB/s wr, 10.14k op/s 2024-09-10T07:52:57.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:56 smithi159 ceph-mon[35522]: pgmap v117: 97 pgs: 97 active+clean; 19 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 66 KiB/s rd, 73 MiB/s wr, 14.27k op/s 2024-09-10T07:52:57.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:56 smithi073 ceph-mon[30850]: pgmap v117: 97 pgs: 97 active+clean; 19 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 66 KiB/s rd, 73 MiB/s wr, 14.27k op/s 2024-09-10T07:52:57.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:56 smithi102 ceph-mon[35514]: pgmap v117: 97 pgs: 97 active+clean; 19 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 66 KiB/s rd, 73 MiB/s wr, 14.27k op/s 2024-09-10T07:52:59.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:52:58 smithi159 ceph-mon[35522]: pgmap v118: 97 pgs: 97 active+clean; 19 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 95 KiB/s rd, 75 MiB/s wr, 14.56k op/s 2024-09-10T07:52:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:52:58 smithi073 ceph-mon[30850]: pgmap v118: 97 pgs: 97 active+clean; 19 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 95 KiB/s rd, 75 MiB/s wr, 14.56k op/s 2024-09-10T07:52:59.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:52:58 smithi102 ceph-mon[35514]: pgmap v118: 97 pgs: 97 active+clean; 19 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 95 KiB/s rd, 75 MiB/s wr, 14.56k op/s 2024-09-10T07:53:01.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:00 smithi073 ceph-mon[30850]: pgmap v119: 97 pgs: 97 active+clean; 19 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 52 KiB/s rd, 73 MiB/s wr, 14.18k op/s 2024-09-10T07:53:01.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:00 smithi102 ceph-mon[35514]: pgmap v119: 97 pgs: 97 active+clean; 19 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 52 KiB/s rd, 73 MiB/s wr, 14.18k op/s 2024-09-10T07:53:01.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:00 smithi159 ceph-mon[35522]: pgmap v119: 97 pgs: 97 active+clean; 19 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 52 KiB/s rd, 73 MiB/s wr, 14.18k op/s 2024-09-10T07:53:02.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:01 smithi073 ceph-mon[30850]: pgmap v120: 97 pgs: 97 active+clean; 20 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 52 KiB/s rd, 96 MiB/s wr, 18.11k op/s 2024-09-10T07:53:02.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:01 smithi102 ceph-mon[35514]: pgmap v120: 97 pgs: 97 active+clean; 20 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 52 KiB/s rd, 96 MiB/s wr, 18.11k op/s 2024-09-10T07:53:02.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:01 smithi159 ceph-mon[35522]: pgmap v120: 97 pgs: 97 active+clean; 20 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 52 KiB/s rd, 96 MiB/s wr, 18.11k op/s 2024-09-10T07:53:05.156 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:04 smithi159 ceph-mon[35522]: pgmap v121: 97 pgs: 97 active+clean; 20 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 43 KiB/s rd, 84 MiB/s wr, 15.60k op/s 2024-09-10T07:53:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:04 smithi073 ceph-mon[30850]: pgmap v121: 97 pgs: 97 active+clean; 20 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 43 KiB/s rd, 84 MiB/s wr, 15.60k op/s 2024-09-10T07:53:05.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:04 smithi102 ceph-mon[35514]: pgmap v121: 97 pgs: 97 active+clean; 20 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 43 KiB/s rd, 84 MiB/s wr, 15.60k op/s 2024-09-10T07:53:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:05 smithi073 ceph-mon[30850]: pgmap v122: 97 pgs: 97 active+clean; 20 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 52 KiB/s rd, 105 MiB/s wr, 19.54k op/s 2024-09-10T07:53:06.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:05 smithi102 ceph-mon[35514]: pgmap v122: 97 pgs: 97 active+clean; 20 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 52 KiB/s rd, 105 MiB/s wr, 19.54k op/s 2024-09-10T07:53:06.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:05 smithi159 ceph-mon[35522]: pgmap v122: 97 pgs: 97 active+clean; 20 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 52 KiB/s rd, 105 MiB/s wr, 19.54k op/s 2024-09-10T07:53:09.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:08 smithi073 ceph-mon[30850]: pgmap v123: 97 pgs: 97 active+clean; 20 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 216 KiB/s rd, 108 MiB/s wr, 19.47k op/s 2024-09-10T07:53:09.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:08 smithi102 ceph-mon[35514]: pgmap v123: 97 pgs: 97 active+clean; 20 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 216 KiB/s rd, 108 MiB/s wr, 19.47k op/s 2024-09-10T07:53:09.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:08 smithi159 ceph-mon[35522]: pgmap v123: 97 pgs: 97 active+clean; 20 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 216 KiB/s rd, 108 MiB/s wr, 19.47k op/s 2024-09-10T07:53:11.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:10 smithi073 ceph-mon[30850]: pgmap v124: 97 pgs: 97 active+clean; 20 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 188 KiB/s rd, 94 MiB/s wr, 16.80k op/s 2024-09-10T07:53:11.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:10 smithi102 ceph-mon[35514]: pgmap v124: 97 pgs: 97 active+clean; 20 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 188 KiB/s rd, 94 MiB/s wr, 16.80k op/s 2024-09-10T07:53:11.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:10 smithi159 ceph-mon[35522]: pgmap v124: 97 pgs: 97 active+clean; 20 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 188 KiB/s rd, 94 MiB/s wr, 16.80k op/s 2024-09-10T07:53:12.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:11 smithi073 ceph-mon[30850]: pgmap v125: 97 pgs: 97 active+clean; 20 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 188 KiB/s rd, 101 MiB/s wr, 18.02k op/s 2024-09-10T07:53:12.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:11 smithi102 ceph-mon[35514]: pgmap v125: 97 pgs: 97 active+clean; 20 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 188 KiB/s rd, 101 MiB/s wr, 18.02k op/s 2024-09-10T07:53:12.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:11 smithi159 ceph-mon[35522]: pgmap v125: 97 pgs: 97 active+clean; 20 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 188 KiB/s rd, 101 MiB/s wr, 18.02k op/s 2024-09-10T07:53:15.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:14 smithi159 ceph-mon[35522]: pgmap v126: 97 pgs: 97 active+clean; 21 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 231 KiB/s rd, 87 MiB/s wr, 15.55k op/s 2024-09-10T07:53:15.223 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:14 smithi073 ceph-mon[30850]: pgmap v126: 97 pgs: 97 active+clean; 21 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 231 KiB/s rd, 87 MiB/s wr, 15.55k op/s 2024-09-10T07:53:15.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:14 smithi102 ceph-mon[35514]: pgmap v126: 97 pgs: 97 active+clean; 21 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 231 KiB/s rd, 87 MiB/s wr, 15.55k op/s 2024-09-10T07:53:16.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:15 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:53:16.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:15 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:53:16.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:15 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:53:16.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:15 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:53:16.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:15 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:53:16.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:15 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:53:16.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:15 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:53:16.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:15 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:53:16.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:15 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:53:16.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:15 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:53:16.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:15 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:53:16.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:15 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:53:17.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:16 smithi073 ceph-mon[30850]: pgmap v127: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 216 KiB/s rd, 82 MiB/s wr, 14.72k op/s 2024-09-10T07:53:17.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:16 smithi102 ceph-mon[35514]: pgmap v127: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 216 KiB/s rd, 82 MiB/s wr, 14.72k op/s 2024-09-10T07:53:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:16 smithi159 ceph-mon[35522]: pgmap v127: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 216 KiB/s rd, 82 MiB/s wr, 14.72k op/s 2024-09-10T07:53:18.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:17 smithi073 ceph-mon[30850]: pgmap v128: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 977 GiB / 1.0 TiB avail; 233 KiB/s rd, 67 MiB/s wr, 11.81k op/s 2024-09-10T07:53:18.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:17 smithi102 ceph-mon[35514]: pgmap v128: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 977 GiB / 1.0 TiB avail; 233 KiB/s rd, 67 MiB/s wr, 11.81k op/s 2024-09-10T07:53:18.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:17 smithi159 ceph-mon[35522]: pgmap v128: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 977 GiB / 1.0 TiB avail; 233 KiB/s rd, 67 MiB/s wr, 11.81k op/s 2024-09-10T07:53:21.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:20 smithi073 ceph-mon[30850]: pgmap v129: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 977 GiB / 1.0 TiB avail; 69 KiB/s rd, 46 MiB/s wr, 8.13k op/s 2024-09-10T07:53:21.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:20 smithi102 ceph-mon[35514]: pgmap v129: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 977 GiB / 1.0 TiB avail; 69 KiB/s rd, 46 MiB/s wr, 8.13k op/s 2024-09-10T07:53:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:20 smithi159 ceph-mon[35522]: pgmap v129: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 977 GiB / 1.0 TiB avail; 69 KiB/s rd, 46 MiB/s wr, 8.13k op/s 2024-09-10T07:53:22.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:21 smithi073 ceph-mon[30850]: pgmap v130: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 69 KiB/s rd, 67 MiB/s wr, 11.71k op/s 2024-09-10T07:53:22.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:21 smithi102 ceph-mon[35514]: pgmap v130: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 69 KiB/s rd, 67 MiB/s wr, 11.71k op/s 2024-09-10T07:53:22.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:21 smithi159 ceph-mon[35522]: pgmap v130: 97 pgs: 97 active+clean; 21 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 69 KiB/s rd, 67 MiB/s wr, 11.71k op/s 2024-09-10T07:53:25.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:24 smithi073 ceph-mon[30850]: pgmap v131: 97 pgs: 97 active+clean; 21 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 82 KiB/s rd, 76 MiB/s wr, 12.97k op/s 2024-09-10T07:53:25.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:24 smithi102 ceph-mon[35514]: pgmap v131: 97 pgs: 97 active+clean; 21 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 82 KiB/s rd, 76 MiB/s wr, 12.97k op/s 2024-09-10T07:53:25.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:24 smithi159 ceph-mon[35522]: pgmap v131: 97 pgs: 97 active+clean; 21 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 82 KiB/s rd, 76 MiB/s wr, 12.97k op/s 2024-09-10T07:53:27.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:26 smithi102 ceph-mon[35514]: pgmap v132: 97 pgs: 97 active+clean; 21 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 40 KiB/s rd, 80 MiB/s wr, 13.81k op/s 2024-09-10T07:53:27.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:26 smithi073 ceph-mon[30850]: pgmap v132: 97 pgs: 97 active+clean; 21 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 40 KiB/s rd, 80 MiB/s wr, 13.81k op/s 2024-09-10T07:53:27.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:26 smithi159 ceph-mon[35522]: pgmap v132: 97 pgs: 97 active+clean; 21 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 40 KiB/s rd, 80 MiB/s wr, 13.81k op/s 2024-09-10T07:53:28.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:27 smithi073 ceph-mon[30850]: pgmap v133: 97 pgs: 97 active+clean; 21 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 39 KiB/s rd, 78 MiB/s wr, 13.37k op/s 2024-09-10T07:53:28.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:27 smithi102 ceph-mon[35514]: pgmap v133: 97 pgs: 97 active+clean; 21 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 39 KiB/s rd, 78 MiB/s wr, 13.37k op/s 2024-09-10T07:53:28.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:27 smithi159 ceph-mon[35522]: pgmap v133: 97 pgs: 97 active+clean; 21 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 39 KiB/s rd, 78 MiB/s wr, 13.37k op/s 2024-09-10T07:53:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:30 smithi073 ceph-mon[30850]: pgmap v134: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 24 KiB/s rd, 89 MiB/s wr, 15.50k op/s 2024-09-10T07:53:31.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:30 smithi102 ceph-mon[35514]: pgmap v134: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 24 KiB/s rd, 89 MiB/s wr, 15.50k op/s 2024-09-10T07:53:31.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:30 smithi159 ceph-mon[35522]: pgmap v134: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 24 KiB/s rd, 89 MiB/s wr, 15.50k op/s 2024-09-10T07:53:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:32 smithi073 ceph-mon[30850]: pgmap v135: 97 pgs: 97 active+clean; 22 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 24 KiB/s rd, 104 MiB/s wr, 18.37k op/s 2024-09-10T07:53:33.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:32 smithi102 ceph-mon[35514]: pgmap v135: 97 pgs: 97 active+clean; 22 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 24 KiB/s rd, 104 MiB/s wr, 18.37k op/s 2024-09-10T07:53:33.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:32 smithi159 ceph-mon[35522]: pgmap v135: 97 pgs: 97 active+clean; 22 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 24 KiB/s rd, 104 MiB/s wr, 18.37k op/s 2024-09-10T07:53:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:34 smithi073 ceph-mon[30850]: pgmap v136: 97 pgs: 97 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 49 KiB/s rd, 89 MiB/s wr, 16.06k op/s 2024-09-10T07:53:35.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:34 smithi102 ceph-mon[35514]: pgmap v136: 97 pgs: 97 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 49 KiB/s rd, 89 MiB/s wr, 16.06k op/s 2024-09-10T07:53:35.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:34 smithi159 ceph-mon[35522]: pgmap v136: 97 pgs: 97 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 49 KiB/s rd, 89 MiB/s wr, 16.06k op/s 2024-09-10T07:53:36.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:35 smithi073 ceph-mon[30850]: pgmap v137: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 36 KiB/s rd, 75 MiB/s wr, 14.18k op/s 2024-09-10T07:53:36.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:35 smithi102 ceph-mon[35514]: pgmap v137: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 36 KiB/s rd, 75 MiB/s wr, 14.18k op/s 2024-09-10T07:53:36.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:35 smithi159 ceph-mon[35522]: pgmap v137: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 36 KiB/s rd, 75 MiB/s wr, 14.18k op/s 2024-09-10T07:53:39.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:38 smithi073 ceph-mon[30850]: pgmap v138: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 36 KiB/s rd, 67 MiB/s wr, 13.03k op/s 2024-09-10T07:53:39.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:38 smithi102 ceph-mon[35514]: pgmap v138: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 36 KiB/s rd, 67 MiB/s wr, 13.03k op/s 2024-09-10T07:53:39.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:38 smithi159 ceph-mon[35522]: pgmap v138: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 36 KiB/s rd, 67 MiB/s wr, 13.03k op/s 2024-09-10T07:53:41.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:40 smithi073 ceph-mon[30850]: pgmap v139: 97 pgs: 97 active+clean; 22 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 62 KiB/s rd, 67 MiB/s wr, 13.15k op/s 2024-09-10T07:53:41.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:40 smithi102 ceph-mon[35514]: pgmap v139: 97 pgs: 97 active+clean; 22 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 62 KiB/s rd, 67 MiB/s wr, 13.15k op/s 2024-09-10T07:53:41.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:40 smithi159 ceph-mon[35522]: pgmap v139: 97 pgs: 97 active+clean; 22 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 62 KiB/s rd, 67 MiB/s wr, 13.15k op/s 2024-09-10T07:53:42.226 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:41 smithi073 ceph-mon[30850]: pgmap v140: 97 pgs: 97 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 52 KiB/s rd, 59 MiB/s wr, 11.94k op/s 2024-09-10T07:53:42.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:41 smithi102 ceph-mon[35514]: pgmap v140: 97 pgs: 97 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 52 KiB/s rd, 59 MiB/s wr, 11.94k op/s 2024-09-10T07:53:42.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:41 smithi159 ceph-mon[35522]: pgmap v140: 97 pgs: 97 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 52 KiB/s rd, 59 MiB/s wr, 11.94k op/s 2024-09-10T07:53:45.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:44 smithi073 ceph-mon[30850]: pgmap v141: 97 pgs: 97 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 98 KiB/s rd, 47 MiB/s wr, 9.70k op/s 2024-09-10T07:53:45.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:44 smithi102 ceph-mon[35514]: pgmap v141: 97 pgs: 97 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 98 KiB/s rd, 47 MiB/s wr, 9.70k op/s 2024-09-10T07:53:45.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:44 smithi159 ceph-mon[35522]: pgmap v141: 97 pgs: 97 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 98 KiB/s rd, 47 MiB/s wr, 9.70k op/s 2024-09-10T07:53:47.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:46 smithi073 ceph-mon[30850]: pgmap v142: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 73 KiB/s rd, 45 MiB/s wr, 9.36k op/s 2024-09-10T07:53:47.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:46 smithi102 ceph-mon[35514]: pgmap v142: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 73 KiB/s rd, 45 MiB/s wr, 9.36k op/s 2024-09-10T07:53:47.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:46 smithi159 ceph-mon[35522]: pgmap v142: 97 pgs: 97 active+clean; 22 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 73 KiB/s rd, 45 MiB/s wr, 9.36k op/s 2024-09-10T07:53:48.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:47 smithi102 ceph-mon[35514]: pgmap v143: 97 pgs: 97 active+clean; 23 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 73 KiB/s rd, 43 MiB/s wr, 8.92k op/s 2024-09-10T07:53:48.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:47 smithi159 ceph-mon[35522]: pgmap v143: 97 pgs: 97 active+clean; 23 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 73 KiB/s rd, 43 MiB/s wr, 8.92k op/s 2024-09-10T07:53:48.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:47 smithi073 ceph-mon[30850]: pgmap v143: 97 pgs: 97 active+clean; 23 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 73 KiB/s rd, 43 MiB/s wr, 8.92k op/s 2024-09-10T07:53:50.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:49 smithi102 ceph-mon[35514]: pgmap v144: 97 pgs: 97 active+clean; 23 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 96 KiB/s rd, 38 MiB/s wr, 8.01k op/s 2024-09-10T07:53:50.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:49 smithi159 ceph-mon[35522]: pgmap v144: 97 pgs: 97 active+clean; 23 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 96 KiB/s rd, 38 MiB/s wr, 8.01k op/s 2024-09-10T07:53:50.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:49 smithi073 ceph-mon[30850]: pgmap v144: 97 pgs: 97 active+clean; 23 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 96 KiB/s rd, 38 MiB/s wr, 8.01k op/s 2024-09-10T07:53:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:52 smithi073 ceph-mon[30850]: pgmap v145: 97 pgs: 97 active+clean; 23 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 70 KiB/s rd, 48 MiB/s wr, 10.12k op/s 2024-09-10T07:53:53.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:52 smithi102 ceph-mon[35514]: pgmap v145: 97 pgs: 97 active+clean; 23 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 70 KiB/s rd, 48 MiB/s wr, 10.12k op/s 2024-09-10T07:53:53.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:52 smithi159 ceph-mon[35522]: pgmap v145: 97 pgs: 97 active+clean; 23 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 70 KiB/s rd, 48 MiB/s wr, 10.12k op/s 2024-09-10T07:53:54.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:53 smithi073 ceph-mon[30850]: pgmap v146: 97 pgs: 97 active+clean; 23 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 87 KiB/s rd, 41 MiB/s wr, 8.63k op/s 2024-09-10T07:53:54.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:53 smithi102 ceph-mon[35514]: pgmap v146: 97 pgs: 97 active+clean; 23 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 87 KiB/s rd, 41 MiB/s wr, 8.63k op/s 2024-09-10T07:53:54.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:53 smithi159 ceph-mon[35522]: pgmap v146: 97 pgs: 97 active+clean; 23 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 87 KiB/s rd, 41 MiB/s wr, 8.63k op/s 2024-09-10T07:53:57.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:56 smithi073 ceph-mon[30850]: pgmap v147: 97 pgs: 97 active+clean; 23 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 41 KiB/s rd, 57 MiB/s wr, 11.75k op/s 2024-09-10T07:53:57.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:56 smithi102 ceph-mon[35514]: pgmap v147: 97 pgs: 97 active+clean; 23 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 41 KiB/s rd, 57 MiB/s wr, 11.75k op/s 2024-09-10T07:53:57.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:56 smithi159 ceph-mon[35522]: pgmap v147: 97 pgs: 97 active+clean; 23 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 41 KiB/s rd, 57 MiB/s wr, 11.75k op/s 2024-09-10T07:53:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:58 smithi073 ceph-mon[30850]: pgmap v148: 97 pgs: 97 active+clean; 23 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 58 KiB/s rd, 65 MiB/s wr, 13.08k op/s 2024-09-10T07:53:59.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:58 smithi102 ceph-mon[35514]: pgmap v148: 97 pgs: 97 active+clean; 23 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 58 KiB/s rd, 65 MiB/s wr, 13.08k op/s 2024-09-10T07:53:59.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:58 smithi159 ceph-mon[35522]: pgmap v148: 97 pgs: 97 active+clean; 23 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 58 KiB/s rd, 65 MiB/s wr, 13.08k op/s 2024-09-10T07:54:00.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:53:59 smithi073 ceph-mon[30850]: pgmap v149: 97 pgs: 97 active+clean; 23 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 58 KiB/s rd, 60 MiB/s wr, 11.92k op/s 2024-09-10T07:54:00.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:53:59 smithi102 ceph-mon[35514]: pgmap v149: 97 pgs: 97 active+clean; 23 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 58 KiB/s rd, 60 MiB/s wr, 11.92k op/s 2024-09-10T07:54:00.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:53:59 smithi159 ceph-mon[35522]: pgmap v149: 97 pgs: 97 active+clean; 23 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 58 KiB/s rd, 60 MiB/s wr, 11.92k op/s 2024-09-10T07:54:03.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:02 smithi073 ceph-mon[30850]: pgmap v150: 97 pgs: 97 active+clean; 23 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 36 KiB/s rd, 82 MiB/s wr, 16.35k op/s 2024-09-10T07:54:03.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:02 smithi102 ceph-mon[35514]: pgmap v150: 97 pgs: 97 active+clean; 23 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 36 KiB/s rd, 82 MiB/s wr, 16.35k op/s 2024-09-10T07:54:03.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:02 smithi159 ceph-mon[35522]: pgmap v150: 97 pgs: 97 active+clean; 23 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 36 KiB/s rd, 82 MiB/s wr, 16.35k op/s 2024-09-10T07:54:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:04 smithi073 ceph-mon[30850]: pgmap v151: 97 pgs: 97 active+clean; 23 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 343 KiB/s rd, 67 MiB/s wr, 13.21k op/s 2024-09-10T07:54:05.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:04 smithi102 ceph-mon[35514]: pgmap v151: 97 pgs: 97 active+clean; 23 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 343 KiB/s rd, 67 MiB/s wr, 13.21k op/s 2024-09-10T07:54:05.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:04 smithi159 ceph-mon[35522]: pgmap v151: 97 pgs: 97 active+clean; 23 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 343 KiB/s rd, 67 MiB/s wr, 13.21k op/s 2024-09-10T07:54:07.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:06 smithi073 ceph-mon[30850]: pgmap v152: 97 pgs: 97 active+clean; 24 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 327 KiB/s rd, 85 MiB/s wr, 16.39k op/s 2024-09-10T07:54:07.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:06 smithi102 ceph-mon[35514]: pgmap v152: 97 pgs: 97 active+clean; 24 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 327 KiB/s rd, 85 MiB/s wr, 16.39k op/s 2024-09-10T07:54:07.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:06 smithi159 ceph-mon[35522]: pgmap v152: 97 pgs: 97 active+clean; 24 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 327 KiB/s rd, 85 MiB/s wr, 16.39k op/s 2024-09-10T07:54:08.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:07 smithi073 ceph-mon[30850]: pgmap v153: 97 pgs: 97 active+clean; 24 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 593 KiB/s rd, 85 MiB/s wr, 15.75k op/s 2024-09-10T07:54:08.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:07 smithi102 ceph-mon[35514]: pgmap v153: 97 pgs: 97 active+clean; 24 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 593 KiB/s rd, 85 MiB/s wr, 15.75k op/s 2024-09-10T07:54:08.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:07 smithi159 ceph-mon[35522]: pgmap v153: 97 pgs: 97 active+clean; 24 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 593 KiB/s rd, 85 MiB/s wr, 15.75k op/s 2024-09-10T07:54:10.530 INFO:tasks.workunit.client.0.smithi073.stdout:Wrote -1 instead of 4096 bytes. 2024-09-10T07:54:10.530 INFO:tasks.workunit.client.0.smithi073.stdout:Probably out of disk space 2024-09-10T07:54:10.531 INFO:tasks.workunit.client.0.smithi073.stderr:write: Resource temporarily unavailable 2024-09-10T07:54:11.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:10 smithi073 ceph-mon[30850]: pgmap v154: 97 pgs: 97 active+clean; 24 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 576 KiB/s rd, 70 MiB/s wr, 12.80k op/s 2024-09-10T07:54:11.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:10 smithi102 ceph-mon[35514]: pgmap v154: 97 pgs: 97 active+clean; 24 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 576 KiB/s rd, 70 MiB/s wr, 12.80k op/s 2024-09-10T07:54:11.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:10 smithi159 ceph-mon[35522]: pgmap v154: 97 pgs: 97 active+clean; 24 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 576 KiB/s rd, 70 MiB/s wr, 12.80k op/s 2024-09-10T07:54:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:12 smithi073 ceph-mon[30850]: pgmap v155: 97 pgs: 97 active+clean; 24 GiB data, 99 GiB used, 973 GiB / 1.0 TiB avail; 576 KiB/s rd, 95 MiB/s wr, 17.10k op/s 2024-09-10T07:54:13.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:12 smithi102 ceph-mon[35514]: pgmap v155: 97 pgs: 97 active+clean; 24 GiB data, 99 GiB used, 973 GiB / 1.0 TiB avail; 576 KiB/s rd, 95 MiB/s wr, 17.10k op/s 2024-09-10T07:54:13.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:12 smithi159 ceph-mon[35522]: pgmap v155: 97 pgs: 97 active+clean; 24 GiB data, 99 GiB used, 973 GiB / 1.0 TiB avail; 576 KiB/s rd, 95 MiB/s wr, 17.10k op/s 2024-09-10T07:54:14.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:54:14.175 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-10T07:54:14.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T07:54:14.831 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/ffsb.sh) on smithi073 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 2024-09-10T07:54:15.067 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3b82613308c44a128011ad357b722a86 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/ffsb.sh) on smithi073 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 2024-09-10T07:54:15.070 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-10T07:54:15.080 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-10T07:54:15.080 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T07:54:15.081 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T07:54:15.081 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-10T07:54:15.107 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:14 smithi073 ceph-mon[30850]: pgmap v156: 97 pgs: 97 active+clean; 24 GiB data, 100 GiB used, 973 GiB / 1.0 TiB avail; 604 KiB/s rd, 86 MiB/s wr, 14.75k op/s 2024-09-10T07:54:15.131 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-10T07:54:15.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:14 smithi102 ceph-mon[35514]: pgmap v156: 97 pgs: 97 active+clean; 24 GiB data, 100 GiB used, 973 GiB / 1.0 TiB avail; 604 KiB/s rd, 86 MiB/s wr, 14.75k op/s 2024-09-10T07:54:15.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:14 smithi159 ceph-mon[35522]: pgmap v156: 97 pgs: 97 active+clean; 24 GiB data, 100 GiB used, 973 GiB / 1.0 TiB avail; 604 KiB/s rd, 86 MiB/s wr, 14.75k op/s 2024-09-10T07:54:16.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:15 smithi073 ceph-mon[30850]: pgmap v157: 97 pgs: 97 active+clean; 25 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 297 KiB/s rd, 96 MiB/s wr, 16.42k op/s 2024-09-10T07:54:16.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:15 smithi102 ceph-mon[35514]: pgmap v157: 97 pgs: 97 active+clean; 25 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 297 KiB/s rd, 96 MiB/s wr, 16.42k op/s 2024-09-10T07:54:16.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:15 smithi159 ceph-mon[35522]: pgmap v157: 97 pgs: 97 active+clean; 25 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 297 KiB/s rd, 96 MiB/s wr, 16.42k op/s 2024-09-10T07:54:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:16 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:54:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:16 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:54:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:16 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:54:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:16 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:54:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:16 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:54:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:16 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:54:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:16 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:54:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:16 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:54:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:16 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:54:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:16 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:54:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:16 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:54:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:16 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:54:18.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:17 smithi073 ceph-mon[30850]: pgmap v158: 97 pgs: 97 active+clean; 25 GiB data, 101 GiB used, 971 GiB / 1.0 TiB avail; 297 KiB/s rd, 84 MiB/s wr, 14.35k op/s 2024-09-10T07:54:18.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:17 smithi102 ceph-mon[35514]: pgmap v158: 97 pgs: 97 active+clean; 25 GiB data, 101 GiB used, 971 GiB / 1.0 TiB avail; 297 KiB/s rd, 84 MiB/s wr, 14.35k op/s 2024-09-10T07:54:18.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:17 smithi159 ceph-mon[35522]: pgmap v158: 97 pgs: 97 active+clean; 25 GiB data, 101 GiB used, 971 GiB / 1.0 TiB avail; 297 KiB/s rd, 84 MiB/s wr, 14.35k op/s 2024-09-10T07:54:21.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:20 smithi073 ceph-mon[30850]: pgmap v159: 97 pgs: 97 active+clean; 25 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 76 KiB/s rd, 69 MiB/s wr, 11.71k op/s 2024-09-10T07:54:21.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:20 smithi102 ceph-mon[35514]: pgmap v159: 97 pgs: 97 active+clean; 25 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 76 KiB/s rd, 69 MiB/s wr, 11.71k op/s 2024-09-10T07:54:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:20 smithi159 ceph-mon[35522]: pgmap v159: 97 pgs: 97 active+clean; 25 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 76 KiB/s rd, 69 MiB/s wr, 11.71k op/s 2024-09-10T07:54:23.209 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:22 smithi159 ceph-mon[35522]: pgmap v160: 97 pgs: 97 active+clean; 25 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 77 KiB/s rd, 90 MiB/s wr, 15.23k op/s 2024-09-10T07:54:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:22 smithi073 ceph-mon[30850]: pgmap v160: 97 pgs: 97 active+clean; 25 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 77 KiB/s rd, 90 MiB/s wr, 15.23k op/s 2024-09-10T07:54:23.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:22 smithi102 ceph-mon[35514]: pgmap v160: 97 pgs: 97 active+clean; 25 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 77 KiB/s rd, 90 MiB/s wr, 15.23k op/s 2024-09-10T07:54:25.224 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:24 smithi073 ceph-mon[30850]: pgmap v161: 97 pgs: 97 active+clean; 25 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 76 KiB/s rd, 71 MiB/s wr, 12.03k op/s 2024-09-10T07:54:25.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:24 smithi102 ceph-mon[35514]: pgmap v161: 97 pgs: 97 active+clean; 25 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 76 KiB/s rd, 71 MiB/s wr, 12.03k op/s 2024-09-10T07:54:25.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:24 smithi159 ceph-mon[35522]: pgmap v161: 97 pgs: 97 active+clean; 25 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 76 KiB/s rd, 71 MiB/s wr, 12.03k op/s 2024-09-10T07:54:26.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:26 smithi102 ceph-mon[35514]: pgmap v162: 97 pgs: 97 active+clean; 25 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 62 KiB/s rd, 69 MiB/s wr, 11.75k op/s 2024-09-10T07:54:26.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:26 smithi159 ceph-mon[35522]: pgmap v162: 97 pgs: 97 active+clean; 25 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 62 KiB/s rd, 69 MiB/s wr, 11.75k op/s 2024-09-10T07:54:26.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:26 smithi073 ceph-mon[30850]: pgmap v162: 97 pgs: 97 active+clean; 25 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 62 KiB/s rd, 69 MiB/s wr, 11.75k op/s 2024-09-10T07:54:29.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:28 smithi073 ceph-mon[30850]: pgmap v163: 97 pgs: 97 active+clean; 25 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 62 KiB/s rd, 79 MiB/s wr, 13.53k op/s 2024-09-10T07:54:29.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:28 smithi102 ceph-mon[35514]: pgmap v163: 97 pgs: 97 active+clean; 25 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 62 KiB/s rd, 79 MiB/s wr, 13.53k op/s 2024-09-10T07:54:29.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:28 smithi159 ceph-mon[35522]: pgmap v163: 97 pgs: 97 active+clean; 25 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 62 KiB/s rd, 79 MiB/s wr, 13.53k op/s 2024-09-10T07:54:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:30 smithi073 ceph-mon[30850]: pgmap v164: 97 pgs: 97 active+clean; 25 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 62 KiB/s rd, 78 MiB/s wr, 13.49k op/s 2024-09-10T07:54:31.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:30 smithi102 ceph-mon[35514]: pgmap v164: 97 pgs: 97 active+clean; 25 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 62 KiB/s rd, 78 MiB/s wr, 13.49k op/s 2024-09-10T07:54:31.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:30 smithi159 ceph-mon[35522]: pgmap v164: 97 pgs: 97 active+clean; 25 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 62 KiB/s rd, 78 MiB/s wr, 13.49k op/s 2024-09-10T07:54:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:32 smithi073 ceph-mon[30850]: pgmap v165: 97 pgs: 97 active+clean; 26 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 27 KiB/s rd, 88 MiB/s wr, 15.46k op/s 2024-09-10T07:54:33.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:32 smithi102 ceph-mon[35514]: pgmap v165: 97 pgs: 97 active+clean; 26 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 27 KiB/s rd, 88 MiB/s wr, 15.46k op/s 2024-09-10T07:54:33.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:32 smithi159 ceph-mon[35522]: pgmap v165: 97 pgs: 97 active+clean; 26 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 27 KiB/s rd, 88 MiB/s wr, 15.46k op/s 2024-09-10T07:54:34.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:33 smithi073 ceph-mon[30850]: pgmap v166: 97 pgs: 97 active+clean; 26 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 26 KiB/s rd, 76 MiB/s wr, 13.48k op/s 2024-09-10T07:54:34.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:33 smithi102 ceph-mon[35514]: pgmap v166: 97 pgs: 97 active+clean; 26 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 26 KiB/s rd, 76 MiB/s wr, 13.48k op/s 2024-09-10T07:54:34.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:33 smithi159 ceph-mon[35522]: pgmap v166: 97 pgs: 97 active+clean; 26 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 26 KiB/s rd, 76 MiB/s wr, 13.48k op/s 2024-09-10T07:54:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:36 smithi073 ceph-mon[30850]: pgmap v167: 97 pgs: 97 active+clean; 26 GiB data, 100 GiB used, 973 GiB / 1.0 TiB avail; 67 KiB/s rd, 73 MiB/s wr, 12.95k op/s 2024-09-10T07:54:37.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:36 smithi102 ceph-mon[35514]: pgmap v167: 97 pgs: 97 active+clean; 26 GiB data, 100 GiB used, 973 GiB / 1.0 TiB avail; 67 KiB/s rd, 73 MiB/s wr, 12.95k op/s 2024-09-10T07:54:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:36 smithi159 ceph-mon[35522]: pgmap v167: 97 pgs: 97 active+clean; 26 GiB data, 100 GiB used, 973 GiB / 1.0 TiB avail; 67 KiB/s rd, 73 MiB/s wr, 12.95k op/s 2024-09-10T07:54:39.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:38 smithi073 ceph-mon[30850]: pgmap v168: 97 pgs: 97 active+clean; 26 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 52 KiB/s rd, 69 MiB/s wr, 12.27k op/s 2024-09-10T07:54:39.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:38 smithi102 ceph-mon[35514]: pgmap v168: 97 pgs: 97 active+clean; 26 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 52 KiB/s rd, 69 MiB/s wr, 12.27k op/s 2024-09-10T07:54:39.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:38 smithi159 ceph-mon[35522]: pgmap v168: 97 pgs: 97 active+clean; 26 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 52 KiB/s rd, 69 MiB/s wr, 12.27k op/s 2024-09-10T07:54:41.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:40 smithi073 ceph-mon[30850]: pgmap v169: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 52 KiB/s rd, 50 MiB/s wr, 8.78k op/s 2024-09-10T07:54:41.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:40 smithi102 ceph-mon[35514]: pgmap v169: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 52 KiB/s rd, 50 MiB/s wr, 8.78k op/s 2024-09-10T07:54:41.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:40 smithi159 ceph-mon[35522]: pgmap v169: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 52 KiB/s rd, 50 MiB/s wr, 8.78k op/s 2024-09-10T07:54:43.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:42 smithi073 ceph-mon[30850]: pgmap v170: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 63 KiB/s rd, 42 MiB/s wr, 7.36k op/s 2024-09-10T07:54:43.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:42 smithi102 ceph-mon[35514]: pgmap v170: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 63 KiB/s rd, 42 MiB/s wr, 7.36k op/s 2024-09-10T07:54:43.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:42 smithi159 ceph-mon[35522]: pgmap v170: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 63 KiB/s rd, 42 MiB/s wr, 7.36k op/s 2024-09-10T07:54:45.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:44 smithi073 ceph-mon[30850]: pgmap v171: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 52 KiB/s rd, 27 MiB/s wr, 4.58k op/s 2024-09-10T07:54:45.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:44 smithi102 ceph-mon[35514]: pgmap v171: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 52 KiB/s rd, 27 MiB/s wr, 4.58k op/s 2024-09-10T07:54:45.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:44 smithi159 ceph-mon[35522]: pgmap v171: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 52 KiB/s rd, 27 MiB/s wr, 4.58k op/s 2024-09-10T07:54:47.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:46 smithi073 ceph-mon[30850]: pgmap v172: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 57 KiB/s rd, 18 MiB/s wr, 3.05k op/s 2024-09-10T07:54:47.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:46 smithi102 ceph-mon[35514]: pgmap v172: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 57 KiB/s rd, 18 MiB/s wr, 3.05k op/s 2024-09-10T07:54:47.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:46 smithi159 ceph-mon[35522]: pgmap v172: 97 pgs: 97 active+clean; 26 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 57 KiB/s rd, 18 MiB/s wr, 3.05k op/s 2024-09-10T07:54:48.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:48 smithi102 ceph-mon[35514]: pgmap v173: 97 pgs: 97 active+clean; 26 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 2.48k op/s 2024-09-10T07:54:48.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:48 smithi159 ceph-mon[35522]: pgmap v173: 97 pgs: 97 active+clean; 26 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 2.48k op/s 2024-09-10T07:54:48.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:47 smithi073 ceph-mon[30850]: pgmap v173: 97 pgs: 97 active+clean; 26 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 2.48k op/s 2024-09-10T07:54:51.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:50 smithi073 ceph-mon[30850]: pgmap v174: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 976 GiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 766 op/s 2024-09-10T07:54:51.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:50 smithi102 ceph-mon[35514]: pgmap v174: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 976 GiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 766 op/s 2024-09-10T07:54:51.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:50 smithi159 ceph-mon[35522]: pgmap v174: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 976 GiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 766 op/s 2024-09-10T07:54:53.208 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:52 smithi159 ceph-mon[35522]: pgmap v175: 97 pgs: 97 active+clean; 26 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 2.15k op/s 2024-09-10T07:54:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:52 smithi073 ceph-mon[30850]: pgmap v175: 97 pgs: 97 active+clean; 26 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 2.15k op/s 2024-09-10T07:54:53.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:52 smithi102 ceph-mon[35514]: pgmap v175: 97 pgs: 97 active+clean; 26 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 2.15k op/s 2024-09-10T07:54:55.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:54 smithi073 ceph-mon[30850]: pgmap v176: 97 pgs: 97 active+clean; 26 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 6.4 KiB/s rd, 14 MiB/s wr, 2.58k op/s 2024-09-10T07:54:55.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:54 smithi102 ceph-mon[35514]: pgmap v176: 97 pgs: 97 active+clean; 26 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 6.4 KiB/s rd, 14 MiB/s wr, 2.58k op/s 2024-09-10T07:54:55.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:54 smithi159 ceph-mon[35522]: pgmap v176: 97 pgs: 97 active+clean; 26 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 6.4 KiB/s rd, 14 MiB/s wr, 2.58k op/s 2024-09-10T07:54:57.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:56 smithi073 ceph-mon[30850]: pgmap v177: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 2.86k op/s 2024-09-10T07:54:57.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:56 smithi102 ceph-mon[35514]: pgmap v177: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 2.86k op/s 2024-09-10T07:54:57.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:56 smithi159 ceph-mon[35522]: pgmap v177: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 2.86k op/s 2024-09-10T07:54:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:54:58 smithi073 ceph-mon[30850]: pgmap v178: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 16 MiB/s wr, 2.86k op/s 2024-09-10T07:54:59.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:54:58 smithi102 ceph-mon[35514]: pgmap v178: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 16 MiB/s wr, 2.86k op/s 2024-09-10T07:54:59.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:54:58 smithi159 ceph-mon[35522]: pgmap v178: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 16 MiB/s wr, 2.86k op/s 2024-09-10T07:55:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:00 smithi073 ceph-mon[30850]: pgmap v179: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 8.0 KiB/s rd, 16 MiB/s wr, 2.86k op/s 2024-09-10T07:55:01.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:00 smithi102 ceph-mon[35514]: pgmap v179: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 8.0 KiB/s rd, 16 MiB/s wr, 2.86k op/s 2024-09-10T07:55:01.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:00 smithi159 ceph-mon[35522]: pgmap v179: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 8.0 KiB/s rd, 16 MiB/s wr, 2.86k op/s 2024-09-10T07:55:03.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:02 smithi073 ceph-mon[30850]: pgmap v180: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 MiB/s wr, 2.87k op/s 2024-09-10T07:55:03.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:02 smithi102 ceph-mon[35514]: pgmap v180: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 MiB/s wr, 2.87k op/s 2024-09-10T07:55:03.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:02 smithi159 ceph-mon[35522]: pgmap v180: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 MiB/s wr, 2.87k op/s 2024-09-10T07:55:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:03 smithi073 ceph-mon[30850]: pgmap v181: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 2.51k op/s 2024-09-10T07:55:04.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:03 smithi102 ceph-mon[35514]: pgmap v181: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 2.51k op/s 2024-09-10T07:55:04.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:03 smithi159 ceph-mon[35522]: pgmap v181: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 2.51k op/s 2024-09-10T07:55:07.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:06 smithi073 ceph-mon[30850]: pgmap v182: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 12 KiB/s rd, 18 MiB/s wr, 3.12k op/s 2024-09-10T07:55:07.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:06 smithi102 ceph-mon[35514]: pgmap v182: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 12 KiB/s rd, 18 MiB/s wr, 3.12k op/s 2024-09-10T07:55:07.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:06 smithi159 ceph-mon[35522]: pgmap v182: 97 pgs: 97 active+clean; 26 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 12 KiB/s rd, 18 MiB/s wr, 3.12k op/s 2024-09-10T07:55:09.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:08 smithi073 ceph-mon[30850]: pgmap v183: 97 pgs: 97 active+clean; 27 GiB data, 97 GiB used, 975 GiB / 1.0 TiB avail; 13 KiB/s rd, 39 MiB/s wr, 6.92k op/s 2024-09-10T07:55:09.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:08 smithi102 ceph-mon[35514]: pgmap v183: 97 pgs: 97 active+clean; 27 GiB data, 97 GiB used, 975 GiB / 1.0 TiB avail; 13 KiB/s rd, 39 MiB/s wr, 6.92k op/s 2024-09-10T07:55:09.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:08 smithi159 ceph-mon[35522]: pgmap v183: 97 pgs: 97 active+clean; 27 GiB data, 97 GiB used, 975 GiB / 1.0 TiB avail; 13 KiB/s rd, 39 MiB/s wr, 6.92k op/s 2024-09-10T07:55:11.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:10 smithi073 ceph-mon[30850]: pgmap v184: 97 pgs: 97 active+clean; 27 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 13 KiB/s rd, 48 MiB/s wr, 8.63k op/s 2024-09-10T07:55:11.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:10 smithi102 ceph-mon[35514]: pgmap v184: 97 pgs: 97 active+clean; 27 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 13 KiB/s rd, 48 MiB/s wr, 8.63k op/s 2024-09-10T07:55:11.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:10 smithi159 ceph-mon[35522]: pgmap v184: 97 pgs: 97 active+clean; 27 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 13 KiB/s rd, 48 MiB/s wr, 8.63k op/s 2024-09-10T07:55:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:12 smithi073 ceph-mon[30850]: pgmap v185: 97 pgs: 97 active+clean; 27 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 13 KiB/s rd, 51 MiB/s wr, 9.22k op/s 2024-09-10T07:55:13.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:12 smithi102 ceph-mon[35514]: pgmap v185: 97 pgs: 97 active+clean; 27 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 13 KiB/s rd, 51 MiB/s wr, 9.22k op/s 2024-09-10T07:55:13.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:12 smithi159 ceph-mon[35522]: pgmap v185: 97 pgs: 97 active+clean; 27 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 13 KiB/s rd, 51 MiB/s wr, 9.22k op/s 2024-09-10T07:55:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:14 smithi073 ceph-mon[30850]: pgmap v186: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 30 KiB/s rd, 52 MiB/s wr, 9.46k op/s 2024-09-10T07:55:15.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:14 smithi102 ceph-mon[35514]: pgmap v186: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 30 KiB/s rd, 52 MiB/s wr, 9.46k op/s 2024-09-10T07:55:15.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:14 smithi159 ceph-mon[35522]: pgmap v186: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 30 KiB/s rd, 52 MiB/s wr, 9.46k op/s 2024-09-10T07:55:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:16 smithi073 ceph-mon[30850]: pgmap v187: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 27 KiB/s rd, 44 MiB/s wr, 8.01k op/s 2024-09-10T07:55:17.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:16 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:55:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:16 smithi102 ceph-mon[35514]: pgmap v187: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 27 KiB/s rd, 44 MiB/s wr, 8.01k op/s 2024-09-10T07:55:17.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:16 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:55:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:16 smithi159 ceph-mon[35522]: pgmap v187: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 27 KiB/s rd, 44 MiB/s wr, 8.01k op/s 2024-09-10T07:55:17.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:16 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:55:18.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:17 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:55:18.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:17 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:55:18.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:17 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:55:18.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:17 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:55:18.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:17 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:55:18.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:17 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:55:18.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:17 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:55:18.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:17 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:55:18.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:17 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:55:19.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:18 smithi073 ceph-mon[30850]: pgmap v188: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 50 KiB/s rd, 37 MiB/s wr, 6.86k op/s 2024-09-10T07:55:19.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:18 smithi102 ceph-mon[35514]: pgmap v188: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 50 KiB/s rd, 37 MiB/s wr, 6.86k op/s 2024-09-10T07:55:19.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:18 smithi159 ceph-mon[35522]: pgmap v188: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 50 KiB/s rd, 37 MiB/s wr, 6.86k op/s 2024-09-10T07:55:20.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:20 smithi102 ceph-mon[35514]: pgmap v189: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 42 KiB/s rd, 15 MiB/s wr, 2.73k op/s 2024-09-10T07:55:20.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:20 smithi159 ceph-mon[35522]: pgmap v189: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 42 KiB/s rd, 15 MiB/s wr, 2.73k op/s 2024-09-10T07:55:20.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:20 smithi073 ceph-mon[30850]: pgmap v189: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 42 KiB/s rd, 15 MiB/s wr, 2.73k op/s 2024-09-10T07:55:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:22 smithi073 ceph-mon[30850]: pgmap v190: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 42 KiB/s rd, 5.3 MiB/s wr, 1.03k op/s 2024-09-10T07:55:23.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:22 smithi102 ceph-mon[35514]: pgmap v190: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 42 KiB/s rd, 5.3 MiB/s wr, 1.03k op/s 2024-09-10T07:55:23.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:22 smithi159 ceph-mon[35522]: pgmap v190: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 42 KiB/s rd, 5.3 MiB/s wr, 1.03k op/s 2024-09-10T07:55:25.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:24 smithi073 ceph-mon[30850]: pgmap v191: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-09-10T07:55:25.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:24 smithi102 ceph-mon[35514]: pgmap v191: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-09-10T07:55:25.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:24 smithi159 ceph-mon[35522]: pgmap v191: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-09-10T07:55:27.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:26 smithi073 ceph-mon[30850]: pgmap v192: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 30 KiB/s rd, 35 KiB/s wr, 3 op/s 2024-09-10T07:55:27.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:26 smithi102 ceph-mon[35514]: pgmap v192: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 30 KiB/s rd, 35 KiB/s wr, 3 op/s 2024-09-10T07:55:27.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:26 smithi159 ceph-mon[35522]: pgmap v192: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 30 KiB/s rd, 35 KiB/s wr, 3 op/s 2024-09-10T07:55:29.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:28 smithi073 ceph-mon[30850]: pgmap v193: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 33 KiB/s rd, 37 KiB/s wr, 5 op/s 2024-09-10T07:55:29.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:28 smithi102 ceph-mon[35514]: pgmap v193: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 33 KiB/s rd, 37 KiB/s wr, 5 op/s 2024-09-10T07:55:29.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:28 smithi159 ceph-mon[35522]: pgmap v193: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 33 KiB/s rd, 37 KiB/s wr, 5 op/s 2024-09-10T07:55:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:30 smithi073 ceph-mon[30850]: pgmap v194: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 9.7 KiB/s rd, 14 KiB/s wr, 3 op/s 2024-09-10T07:55:31.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:30 smithi102 ceph-mon[35514]: pgmap v194: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 9.7 KiB/s rd, 14 KiB/s wr, 3 op/s 2024-09-10T07:55:31.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:30 smithi159 ceph-mon[35522]: pgmap v194: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 9.7 KiB/s rd, 14 KiB/s wr, 3 op/s 2024-09-10T07:55:32.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:32 smithi102 ceph-mon[35514]: pgmap v195: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 10 KiB/s rd, 14 KiB/s wr, 4 op/s 2024-09-10T07:55:32.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:32 smithi159 ceph-mon[35522]: pgmap v195: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 10 KiB/s rd, 14 KiB/s wr, 4 op/s 2024-09-10T07:55:32.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:32 smithi073 ceph-mon[30850]: pgmap v195: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 10 KiB/s rd, 14 KiB/s wr, 4 op/s 2024-09-10T07:55:35.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:34 smithi073 ceph-mon[30850]: pgmap v196: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 9.7 KiB/s rd, 13 KiB/s wr, 3 op/s 2024-09-10T07:55:35.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:34 smithi102 ceph-mon[35514]: pgmap v196: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 9.7 KiB/s rd, 13 KiB/s wr, 3 op/s 2024-09-10T07:55:35.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:34 smithi159 ceph-mon[35522]: pgmap v196: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 9.7 KiB/s rd, 13 KiB/s wr, 3 op/s 2024-09-10T07:55:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:36 smithi073 ceph-mon[30850]: pgmap v197: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 2 op/s 2024-09-10T07:55:37.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:36 smithi102 ceph-mon[35514]: pgmap v197: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 2 op/s 2024-09-10T07:55:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:36 smithi159 ceph-mon[35522]: pgmap v197: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 2 op/s 2024-09-10T07:55:39.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:38 smithi073 ceph-mon[30850]: pgmap v198: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.7 KiB/s wr, 2 op/s 2024-09-10T07:55:39.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:38 smithi102 ceph-mon[35514]: pgmap v198: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.7 KiB/s wr, 2 op/s 2024-09-10T07:55:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:38 smithi159 ceph-mon[35522]: pgmap v198: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.7 KiB/s wr, 2 op/s 2024-09-10T07:55:41.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:40 smithi073 ceph-mon[30850]: pgmap v199: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-10T07:55:41.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:40 smithi102 ceph-mon[35514]: pgmap v199: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-10T07:55:41.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:40 smithi159 ceph-mon[35522]: pgmap v199: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-10T07:55:42.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:42 smithi102 ceph-mon[35514]: pgmap v200: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:55:42.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:42 smithi159 ceph-mon[35522]: pgmap v200: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:55:42.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:42 smithi073 ceph-mon[30850]: pgmap v200: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:55:45.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:44 smithi073 ceph-mon[30850]: pgmap v201: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:55:45.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:44 smithi102 ceph-mon[35514]: pgmap v201: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:55:45.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:44 smithi159 ceph-mon[35522]: pgmap v201: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:55:47.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:46 smithi073 ceph-mon[30850]: pgmap v202: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:55:47.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:46 smithi102 ceph-mon[35514]: pgmap v202: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:55:47.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:46 smithi159 ceph-mon[35522]: pgmap v202: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:55:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:48 smithi073 ceph-mon[30850]: pgmap v203: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:55:49.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:48 smithi102 ceph-mon[35514]: pgmap v203: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:55:49.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:48 smithi159 ceph-mon[35522]: pgmap v203: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:55:51.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:50 smithi073 ceph-mon[30850]: pgmap v204: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:55:51.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:50 smithi102 ceph-mon[35514]: pgmap v204: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:55:51.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:50 smithi159 ceph-mon[35522]: pgmap v204: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:55:53.209 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:52 smithi159 ceph-mon[35522]: pgmap v205: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:55:53.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:52 smithi073 ceph-mon[30850]: pgmap v205: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:55:53.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:52 smithi102 ceph-mon[35514]: pgmap v205: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:55:54.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:54 smithi102 ceph-mon[35514]: pgmap v206: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:55:54.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:54 smithi159 ceph-mon[35522]: pgmap v206: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:55:54.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:54 smithi073 ceph-mon[30850]: pgmap v206: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:55:57.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:56 smithi073 ceph-mon[30850]: pgmap v207: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:55:57.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:56 smithi102 ceph-mon[35514]: pgmap v207: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:55:57.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:56 smithi159 ceph-mon[35522]: pgmap v207: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:55:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:55:58 smithi073 ceph-mon[30850]: pgmap v208: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:55:59.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:55:58 smithi102 ceph-mon[35514]: pgmap v208: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:55:59.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:55:58 smithi159 ceph-mon[35522]: pgmap v208: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:01.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:00 smithi073 ceph-mon[30850]: pgmap v209: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:01.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:00 smithi102 ceph-mon[35514]: pgmap v209: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:01.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:00 smithi159 ceph-mon[35522]: pgmap v209: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:03.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:02 smithi073 ceph-mon[30850]: pgmap v210: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:56:03.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:02 smithi102 ceph-mon[35514]: pgmap v210: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:56:03.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:02 smithi159 ceph-mon[35522]: pgmap v210: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:56:05.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:04 smithi073 ceph-mon[30850]: pgmap v211: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:56:05.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:04 smithi102 ceph-mon[35514]: pgmap v211: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:56:05.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:04 smithi159 ceph-mon[35522]: pgmap v211: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:56:06.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:05 smithi073 ceph-mon[30850]: pgmap v212: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-10T07:56:06.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:05 smithi102 ceph-mon[35514]: pgmap v212: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-10T07:56:06.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:05 smithi159 ceph-mon[35522]: pgmap v212: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-10T07:56:08.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:08 smithi159 ceph-mon[35522]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T07:56:08.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:08 smithi159 ceph-mon[35522]: pgmap v214: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:56:08.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:08 smithi073 ceph-mon[30850]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T07:56:08.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:08 smithi073 ceph-mon[30850]: pgmap v214: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:56:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:08 smithi102 ceph-mon[35514]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T07:56:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:08 smithi102 ceph-mon[35514]: pgmap v214: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:56:11.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:10 smithi073 ceph-mon[30850]: pgmap v215: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:56:11.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:10 smithi102 ceph-mon[35514]: pgmap v215: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:56:11.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:10 smithi159 ceph-mon[35522]: pgmap v215: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:56:13.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:12 smithi073 ceph-mon[30850]: pgmap v216: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:56:13.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:12 smithi102 ceph-mon[35514]: pgmap v216: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:56:13.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:12 smithi159 ceph-mon[35522]: pgmap v216: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:56:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:14 smithi073 ceph-mon[30850]: pgmap v217: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-10T07:56:15.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:14 smithi102 ceph-mon[35514]: pgmap v217: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-10T07:56:15.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:14 smithi159 ceph-mon[35522]: pgmap v217: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-10T07:56:16.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:16 smithi102 ceph-mon[35514]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T07:56:16.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:16 smithi102 ceph-mon[35514]: pgmap v219: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 742 B/s rd, 123 B/s wr, 1 op/s 2024-09-10T07:56:16.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:16 smithi159 ceph-mon[35522]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T07:56:16.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:16 smithi159 ceph-mon[35522]: pgmap v219: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 742 B/s rd, 123 B/s wr, 1 op/s 2024-09-10T07:56:16.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:16 smithi073 ceph-mon[30850]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T07:56:16.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:16 smithi073 ceph-mon[30850]: pgmap v219: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 742 B/s rd, 123 B/s wr, 1 op/s 2024-09-10T07:56:17.623 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:17 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:56:17.625 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:17 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:56:17.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:17 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:56:18.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:18 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:56:18.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:18 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:56:18.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:18 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:56:18.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:18 smithi102 ceph-mon[35514]: pgmap v220: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:56:18.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:18 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:56:18.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:18 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:56:18.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:18 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:56:18.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:18 smithi159 ceph-mon[35522]: pgmap v220: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:56:18.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:18 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:56:18.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:18 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:56:18.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:18 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:56:18.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:18 smithi073 ceph-mon[30850]: pgmap v220: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:56:21.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:20 smithi073 ceph-mon[30850]: pgmap v221: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:56:21.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:20 smithi102 ceph-mon[35514]: pgmap v221: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:56:21.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:20 smithi159 ceph-mon[35522]: pgmap v221: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:56:23.208 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:22 smithi159 ceph-mon[35522]: pgmap v222: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:56:23.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:22 smithi073 ceph-mon[30850]: pgmap v222: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:56:23.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:22 smithi102 ceph-mon[35514]: pgmap v222: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:56:25.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:24 smithi073 ceph-mon[30850]: pgmap v223: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:56:25.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:24 smithi102 ceph-mon[35514]: pgmap v223: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:56:25.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:24 smithi159 ceph-mon[35522]: pgmap v223: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:56:26.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:25 smithi073 ceph-mon[30850]: pgmap v224: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.0 KiB/s rd, 95 B/s wr, 2 op/s 2024-09-10T07:56:26.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:25 smithi102 ceph-mon[35514]: pgmap v224: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.0 KiB/s rd, 95 B/s wr, 2 op/s 2024-09-10T07:56:26.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:25 smithi159 ceph-mon[35522]: pgmap v224: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.0 KiB/s rd, 95 B/s wr, 2 op/s 2024-09-10T07:56:29.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:28 smithi073 ceph-mon[30850]: pgmap v225: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:56:29.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:28 smithi102 ceph-mon[35514]: pgmap v225: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:56:29.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:28 smithi159 ceph-mon[35522]: pgmap v225: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:56:31.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:30 smithi073 ceph-mon[30850]: pgmap v226: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:31.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:30 smithi102 ceph-mon[35514]: pgmap v226: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:31.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:30 smithi159 ceph-mon[35522]: pgmap v226: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:33.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:32 smithi073 ceph-mon[30850]: pgmap v227: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:33.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:32 smithi102 ceph-mon[35514]: pgmap v227: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:33.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:32 smithi159 ceph-mon[35522]: pgmap v227: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:34.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:33 smithi073 ceph-mon[30850]: pgmap v228: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:56:34.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:33 smithi102 ceph-mon[35514]: pgmap v228: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:56:34.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:33 smithi159 ceph-mon[35522]: pgmap v228: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:56:37.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:36 smithi073 ceph-mon[30850]: pgmap v229: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:37.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:36 smithi102 ceph-mon[35514]: pgmap v229: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:36 smithi159 ceph-mon[35522]: pgmap v229: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:39.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:38 smithi073 ceph-mon[30850]: pgmap v230: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:39.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:38 smithi102 ceph-mon[35514]: pgmap v230: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:38 smithi159 ceph-mon[35522]: pgmap v230: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:40.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:40 smithi102 ceph-mon[35514]: pgmap v231: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:40 smithi159 ceph-mon[35522]: pgmap v231: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:40.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:40 smithi073 ceph-mon[30850]: pgmap v231: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:43.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:42 smithi073 ceph-mon[30850]: pgmap v232: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:43.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:42 smithi102 ceph-mon[35514]: pgmap v232: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:43.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:42 smithi159 ceph-mon[35522]: pgmap v232: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:45.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:44 smithi073 ceph-mon[30850]: pgmap v233: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:56:45.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:44 smithi102 ceph-mon[35514]: pgmap v233: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:56:45.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:44 smithi159 ceph-mon[35522]: pgmap v233: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:56:46.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:45 smithi073 ceph-mon[30850]: pgmap v234: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:46.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:45 smithi102 ceph-mon[35514]: pgmap v234: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:46.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:45 smithi159 ceph-mon[35522]: pgmap v234: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:49.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:48 smithi073 ceph-mon[30850]: pgmap v235: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:49.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:48 smithi102 ceph-mon[35514]: pgmap v235: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:49.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:48 smithi159 ceph-mon[35522]: pgmap v235: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:51.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:50 smithi073 ceph-mon[30850]: pgmap v236: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:51.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:50 smithi102 ceph-mon[35514]: pgmap v236: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:51.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:50 smithi159 ceph-mon[35522]: pgmap v236: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:52.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:51 smithi073 ceph-mon[30850]: pgmap v237: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:52.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:51 smithi102 ceph-mon[35514]: pgmap v237: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:52.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:51 smithi159 ceph-mon[35522]: pgmap v237: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:55.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:54 smithi073 ceph-mon[30850]: pgmap v238: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:56:55.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:54 smithi102 ceph-mon[35514]: pgmap v238: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:56:55.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:54 smithi159 ceph-mon[35522]: pgmap v238: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:56:56.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:56 smithi102 ceph-mon[35514]: pgmap v239: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:56.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:56 smithi159 ceph-mon[35522]: pgmap v239: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:56.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:56 smithi073 ceph-mon[30850]: pgmap v239: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:56:59.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:56:58 smithi073 ceph-mon[30850]: pgmap v240: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:59.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:56:58 smithi102 ceph-mon[35514]: pgmap v240: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:56:59.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:56:58 smithi159 ceph-mon[35522]: pgmap v240: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:57:00.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:00 smithi102 ceph-mon[35514]: pgmap v241: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:00.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:00 smithi159 ceph-mon[35522]: pgmap v241: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:00.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:00 smithi073 ceph-mon[30850]: pgmap v241: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:03.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:02 smithi073 ceph-mon[30850]: pgmap v242: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:57:03.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:02 smithi102 ceph-mon[35514]: pgmap v242: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:57:03.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:02 smithi159 ceph-mon[35522]: pgmap v242: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:57:04.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:03 smithi073 ceph-mon[30850]: pgmap v243: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:57:04.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:03 smithi102 ceph-mon[35514]: pgmap v243: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:57:04.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:03 smithi159 ceph-mon[35522]: pgmap v243: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:57:07.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:06 smithi073 ceph-mon[30850]: pgmap v244: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-10T07:57:07.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:06 smithi102 ceph-mon[35514]: pgmap v244: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-10T07:57:07.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:06 smithi159 ceph-mon[35522]: pgmap v244: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-10T07:57:08.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:07 smithi073 ceph-mon[30850]: pgmap v245: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-10T07:57:08.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:07 smithi102 ceph-mon[35514]: pgmap v245: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-10T07:57:08.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:07 smithi159 ceph-mon[35522]: pgmap v245: 97 pgs: 97 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-10T07:57:09.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:08 smithi102 ceph-mon[35514]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T07:57:09.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:08 smithi159 ceph-mon[35522]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T07:57:09.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:08 smithi073 ceph-mon[30850]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T07:57:10.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:09 smithi102 ceph-mon[35514]: pgmap v247: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:57:10.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:09 smithi159 ceph-mon[35522]: pgmap v247: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:57:10.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:09 smithi073 ceph-mon[30850]: pgmap v247: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 27 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:57:12.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:12 smithi102 ceph-mon[35514]: pgmap v248: 97 pgs: 10 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 80 active+clean; 25 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:57:12.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:12 smithi159 ceph-mon[35522]: pgmap v248: 97 pgs: 10 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 80 active+clean; 25 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:57:12.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:12 smithi073 ceph-mon[30850]: pgmap v248: 97 pgs: 10 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 80 active+clean; 25 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:57:14.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:14 smithi102 ceph-mon[35514]: pgmap v249: 97 pgs: 15 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 75 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-10T07:57:14.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:14 smithi159 ceph-mon[35522]: pgmap v249: 97 pgs: 15 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 75 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-10T07:57:14.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:14 smithi073 ceph-mon[30850]: pgmap v249: 97 pgs: 15 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 75 active+clean; 22 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-10T07:57:16.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:16 smithi102 ceph-mon[35514]: pgmap v250: 97 pgs: 7 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 87 active+clean; 21 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:57:16.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:16 smithi159 ceph-mon[35522]: pgmap v250: 97 pgs: 7 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 87 active+clean; 21 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:57:16.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:16 smithi073 ceph-mon[30850]: pgmap v250: 97 pgs: 7 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 87 active+clean; 21 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:57:18.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:17 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:57:18.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:17 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:57:18.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:17 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:57:19.123 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:18 smithi073 ceph-mon[30850]: pgmap v251: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:57:19.123 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:18 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:57:19.124 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:18 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:57:19.124 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:18 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:57:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:18 smithi102 ceph-mon[35514]: pgmap v251: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:57:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:18 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:57:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:18 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:57:19.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:18 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:57:19.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:18 smithi159 ceph-mon[35522]: pgmap v251: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:57:19.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:18 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:57:19.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:18 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:57:19.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:18 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:57:20.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:20 smithi102 ceph-mon[35514]: pgmap v252: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 1.0 KiB/s rd, 171 B/s wr, 2 op/s 2024-09-10T07:57:20.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:20 smithi159 ceph-mon[35522]: pgmap v252: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 1.0 KiB/s rd, 171 B/s wr, 2 op/s 2024-09-10T07:57:20.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:20 smithi073 ceph-mon[30850]: pgmap v252: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 1.0 KiB/s rd, 171 B/s wr, 2 op/s 2024-09-10T07:57:21.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:21 smithi102 ceph-mon[35514]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T07:57:21.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:21 smithi159 ceph-mon[35522]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T07:57:21.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:21 smithi073 ceph-mon[30850]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T07:57:22.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:22 smithi102 ceph-mon[35514]: pgmap v254: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:57:22.656 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:22 smithi159 ceph-mon[35522]: pgmap v254: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:57:22.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:22 smithi073 ceph-mon[30850]: pgmap v254: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:57:24.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:24 smithi102 ceph-mon[35514]: pgmap v255: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:57:24.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:24 smithi159 ceph-mon[35522]: pgmap v255: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:57:24.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:24 smithi073 ceph-mon[30850]: pgmap v255: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:57:26.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:26 smithi102 ceph-mon[35514]: pgmap v256: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:57:26.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:26 smithi159 ceph-mon[35522]: pgmap v256: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:57:26.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:26 smithi073 ceph-mon[30850]: pgmap v256: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:57:28.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:28 smithi102 ceph-mon[35514]: pgmap v257: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:57:28.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:28 smithi159 ceph-mon[35522]: pgmap v257: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:57:28.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:28 smithi073 ceph-mon[30850]: pgmap v257: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:57:30.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:30 smithi102 ceph-mon[35514]: pgmap v258: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:57:30.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:30 smithi159 ceph-mon[35522]: pgmap v258: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:57:30.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:30 smithi073 ceph-mon[30850]: pgmap v258: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:57:32.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:32 smithi102 ceph-mon[35514]: pgmap v259: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:57:32.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:32 smithi159 ceph-mon[35522]: pgmap v259: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:57:32.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:32 smithi073 ceph-mon[30850]: pgmap v259: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:57:34.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:34 smithi102 ceph-mon[35514]: pgmap v260: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:57:34.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:34 smithi159 ceph-mon[35522]: pgmap v260: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:57:34.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:34 smithi073 ceph-mon[30850]: pgmap v260: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:57:36.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:36 smithi102 ceph-mon[35514]: pgmap v261: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:36.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:36 smithi159 ceph-mon[35522]: pgmap v261: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:36.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:36 smithi073 ceph-mon[30850]: pgmap v261: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:38.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:38 smithi102 ceph-mon[35514]: pgmap v262: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:57:38.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:38 smithi159 ceph-mon[35522]: pgmap v262: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:57:38.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:38 smithi073 ceph-mon[30850]: pgmap v262: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:57:40.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:40 smithi102 ceph-mon[35514]: pgmap v263: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:40 smithi159 ceph-mon[35522]: pgmap v263: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:40.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:40 smithi073 ceph-mon[30850]: pgmap v263: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:42.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:42 smithi102 ceph-mon[35514]: pgmap v264: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T07:57:42.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:42 smithi159 ceph-mon[35522]: pgmap v264: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T07:57:42.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:42 smithi073 ceph-mon[30850]: pgmap v264: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T07:57:44.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:44 smithi102 ceph-mon[35514]: pgmap v265: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:57:44.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:44 smithi159 ceph-mon[35522]: pgmap v265: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:57:44.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:44 smithi073 ceph-mon[30850]: pgmap v265: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:57:46.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:46 smithi102 ceph-mon[35514]: pgmap v266: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:57:46.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:46 smithi159 ceph-mon[35522]: pgmap v266: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:57:46.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:46 smithi073 ceph-mon[30850]: pgmap v266: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:57:48.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:48 smithi102 ceph-mon[35514]: pgmap v267: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:57:48.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:48 smithi159 ceph-mon[35522]: pgmap v267: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:57:48.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:48 smithi073 ceph-mon[30850]: pgmap v267: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:57:50.274 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:50 smithi073 ceph-mon[30850]: pgmap v268: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:57:50.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:50 smithi102 ceph-mon[35514]: pgmap v268: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:57:50.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:50 smithi159 ceph-mon[35522]: pgmap v268: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-10T07:57:52.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:52 smithi102 ceph-mon[35514]: pgmap v269: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T07:57:52.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:52 smithi159 ceph-mon[35522]: pgmap v269: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T07:57:52.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:52 smithi073 ceph-mon[30850]: pgmap v269: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T07:57:54.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:54 smithi102 ceph-mon[35514]: pgmap v270: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:57:54.406 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:54 smithi159 ceph-mon[35522]: pgmap v270: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:57:54.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:54 smithi073 ceph-mon[30850]: pgmap v270: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:57:56.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:56 smithi102 ceph-mon[35514]: pgmap v271: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:56.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:56 smithi159 ceph-mon[35522]: pgmap v271: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:56.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:56 smithi073 ceph-mon[30850]: pgmap v271: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:57:58.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:57:58 smithi102 ceph-mon[35514]: pgmap v272: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:57:58.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:57:58 smithi159 ceph-mon[35522]: pgmap v272: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:57:58.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:57:58 smithi073 ceph-mon[30850]: pgmap v272: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:00.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:00 smithi102 ceph-mon[35514]: pgmap v273: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:00.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:00 smithi159 ceph-mon[35522]: pgmap v273: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:00.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:00 smithi073 ceph-mon[30850]: pgmap v273: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:02.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:02 smithi102 ceph-mon[35514]: pgmap v274: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:58:02.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:02 smithi159 ceph-mon[35522]: pgmap v274: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:58:02.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:02 smithi073 ceph-mon[30850]: pgmap v274: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:58:04.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:04 smithi102 ceph-mon[35514]: pgmap v275: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:58:04.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:04 smithi159 ceph-mon[35522]: pgmap v275: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:58:04.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:04 smithi073 ceph-mon[30850]: pgmap v275: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:58:06.625 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:06 smithi102 ceph-mon[35514]: pgmap v276: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-10T07:58:06.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:06 smithi159 ceph-mon[35522]: pgmap v276: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-10T07:58:06.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:06 smithi073 ceph-mon[30850]: pgmap v276: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-10T07:58:08.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:08 smithi159 ceph-mon[35522]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T07:58:08.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:08 smithi159 ceph-mon[35522]: pgmap v278: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:58:08.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:08 smithi073 ceph-mon[30850]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T07:58:09.072 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:08 smithi073 ceph-mon[30850]: pgmap v278: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:58:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:08 smithi102 ceph-mon[35514]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T07:58:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:08 smithi102 ceph-mon[35514]: pgmap v278: 97 pgs: 97 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:58:10.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:10 smithi102 ceph-mon[35514]: pgmap v279: 97 pgs: 7 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 86 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:58:10.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:10 smithi159 ceph-mon[35522]: pgmap v279: 97 pgs: 7 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 86 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:58:10.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:10 smithi073 ceph-mon[30850]: pgmap v279: 97 pgs: 7 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 86 active+clean; 21 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-10T07:58:12.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:12 smithi102 ceph-mon[35514]: pgmap v280: 97 pgs: 19 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 68 active+clean; 20 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:58:12.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:12 smithi159 ceph-mon[35522]: pgmap v280: 97 pgs: 19 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 68 active+clean; 20 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:58:12.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:12 smithi073 ceph-mon[30850]: pgmap v280: 97 pgs: 19 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 68 active+clean; 20 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:58:14.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:14 smithi102 ceph-mon[35514]: pgmap v281: 97 pgs: 24 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 63 active+clean; 17 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-10T07:58:14.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:14 smithi159 ceph-mon[35522]: pgmap v281: 97 pgs: 24 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 63 active+clean; 17 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-10T07:58:14.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:14 smithi073 ceph-mon[30850]: pgmap v281: 97 pgs: 24 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 63 active+clean; 17 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-10T07:58:16.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:16 smithi102 ceph-mon[35514]: pgmap v282: 97 pgs: 16 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 75 active+clean; 17 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:58:16.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:16 smithi159 ceph-mon[35522]: pgmap v282: 97 pgs: 16 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 75 active+clean; 17 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:58:16.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:16 smithi073 ceph-mon[30850]: pgmap v282: 97 pgs: 16 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 75 active+clean; 17 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:58:18.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:18 smithi102 ceph-mon[35514]: pgmap v283: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 198 B/s wr, 2 op/s 2024-09-10T07:58:18.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:18 smithi159 ceph-mon[35522]: pgmap v283: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 198 B/s wr, 2 op/s 2024-09-10T07:58:18.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:18 smithi073 ceph-mon[30850]: pgmap v283: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 198 B/s wr, 2 op/s 2024-09-10T07:58:19.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:19 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:58:19.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:19 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:58:19.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:19 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:58:19.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:19 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:58:19.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:19 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:58:19.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:19 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:58:19.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:19 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:58:19.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:19 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:58:19.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:19 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:58:19.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:19 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:58:19.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:19 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:58:19.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:19 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:58:20.373 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:20 smithi073 ceph-mon[30850]: pgmap v284: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-10T07:58:20.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:20 smithi102 ceph-mon[35514]: pgmap v284: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-10T07:58:20.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:20 smithi159 ceph-mon[35522]: pgmap v284: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-10T07:58:21.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:21 smithi102 ceph-mon[35514]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T07:58:21.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:21 smithi159 ceph-mon[35522]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T07:58:21.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:21 smithi073 ceph-mon[30850]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T07:58:22.625 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:22 smithi102 ceph-mon[35514]: pgmap v286: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:58:22.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:22 smithi159 ceph-mon[35522]: pgmap v286: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:58:22.726 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:22 smithi073 ceph-mon[30850]: pgmap v286: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-10T07:58:24.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:24 smithi102 ceph-mon[35514]: pgmap v287: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:58:24.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:24 smithi159 ceph-mon[35522]: pgmap v287: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:58:24.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:24 smithi073 ceph-mon[30850]: pgmap v287: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:58:26.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:26 smithi102 ceph-mon[35514]: pgmap v288: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:58:26.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:26 smithi159 ceph-mon[35522]: pgmap v288: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:58:26.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:26 smithi073 ceph-mon[30850]: pgmap v288: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:58:28.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:28 smithi102 ceph-mon[35514]: pgmap v289: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:58:28.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:28 smithi159 ceph-mon[35522]: pgmap v289: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:58:28.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:28 smithi073 ceph-mon[30850]: pgmap v289: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:58:30.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:30 smithi102 ceph-mon[35514]: pgmap v290: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:58:30.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:30 smithi159 ceph-mon[35522]: pgmap v290: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:58:30.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:30 smithi073 ceph-mon[30850]: pgmap v290: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:58:32.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:32 smithi102 ceph-mon[35514]: pgmap v291: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:58:32.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:32 smithi159 ceph-mon[35522]: pgmap v291: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:58:32.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:32 smithi073 ceph-mon[30850]: pgmap v291: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:58:34.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:34 smithi102 ceph-mon[35514]: pgmap v292: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:58:34.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:34 smithi159 ceph-mon[35522]: pgmap v292: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:58:34.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:34 smithi073 ceph-mon[30850]: pgmap v292: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:58:36.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:36 smithi102 ceph-mon[35514]: pgmap v293: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:36.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:36 smithi159 ceph-mon[35522]: pgmap v293: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:36.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:36 smithi073 ceph-mon[30850]: pgmap v293: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:38.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:38 smithi102 ceph-mon[35514]: pgmap v294: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:38 smithi159 ceph-mon[35522]: pgmap v294: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:38.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:38 smithi073 ceph-mon[30850]: pgmap v294: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:40.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:40 smithi102 ceph-mon[35514]: pgmap v295: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:40 smithi159 ceph-mon[35522]: pgmap v295: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:40.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:40 smithi073 ceph-mon[30850]: pgmap v295: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:42.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:42 smithi102 ceph-mon[35514]: pgmap v296: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:42.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:42 smithi159 ceph-mon[35522]: pgmap v296: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:42.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:42 smithi073 ceph-mon[30850]: pgmap v296: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:44.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:44 smithi102 ceph-mon[35514]: pgmap v297: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:58:44.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:44 smithi159 ceph-mon[35522]: pgmap v297: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:58:44.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:44 smithi073 ceph-mon[30850]: pgmap v297: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:58:46.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:46 smithi102 ceph-mon[35514]: pgmap v298: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:46.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:46 smithi159 ceph-mon[35522]: pgmap v298: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:46.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:46 smithi073 ceph-mon[30850]: pgmap v298: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:48.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:48 smithi102 ceph-mon[35514]: pgmap v299: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:48.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:48 smithi159 ceph-mon[35522]: pgmap v299: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:48.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:48 smithi073 ceph-mon[30850]: pgmap v299: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:50.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:50 smithi102 ceph-mon[35514]: pgmap v300: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:50.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:50 smithi159 ceph-mon[35522]: pgmap v300: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:50.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:50 smithi073 ceph-mon[30850]: pgmap v300: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:52.377 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:52 smithi102 ceph-mon[35514]: pgmap v301: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:52.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:52 smithi159 ceph-mon[35522]: pgmap v301: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:52.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:52 smithi073 ceph-mon[30850]: pgmap v301: 97 pgs: 97 active+clean; 17 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:54.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:54 smithi102 ceph-mon[35514]: pgmap v302: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:58:54.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:54 smithi159 ceph-mon[35522]: pgmap v302: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:58:54.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:54 smithi073 ceph-mon[30850]: pgmap v302: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:58:56.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:56 smithi102 ceph-mon[35514]: pgmap v303: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:56.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:56 smithi159 ceph-mon[35522]: pgmap v303: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:56.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:56 smithi073 ceph-mon[30850]: pgmap v303: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:58:58.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:58:58 smithi102 ceph-mon[35514]: pgmap v304: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:58.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:58:58 smithi159 ceph-mon[35522]: pgmap v304: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:58:58.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:58:58 smithi073 ceph-mon[30850]: pgmap v304: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:59:00.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:00 smithi102 ceph-mon[35514]: pgmap v305: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:59:00.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:00 smithi159 ceph-mon[35522]: pgmap v305: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:59:00.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:00 smithi073 ceph-mon[30850]: pgmap v305: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:59:02.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:02 smithi102 ceph-mon[35514]: pgmap v306: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:59:02.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:02 smithi159 ceph-mon[35522]: pgmap v306: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:59:02.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:02 smithi073 ceph-mon[30850]: pgmap v306: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:59:04.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:04 smithi102 ceph-mon[35514]: pgmap v307: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:59:04.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:04 smithi159 ceph-mon[35522]: pgmap v307: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:59:04.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:04 smithi073 ceph-mon[30850]: pgmap v307: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-10T07:59:06.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:06 smithi102 ceph-mon[35514]: pgmap v308: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-10T07:59:06.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:06 smithi159 ceph-mon[35522]: pgmap v308: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-10T07:59:06.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:06 smithi073 ceph-mon[30850]: pgmap v308: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-10T07:59:08.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:08 smithi159 ceph-mon[35522]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T07:59:08.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:08 smithi159 ceph-mon[35522]: pgmap v310: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:59:08.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:08 smithi073 ceph-mon[30850]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T07:59:08.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:08 smithi073 ceph-mon[30850]: pgmap v310: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:59:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:08 smithi102 ceph-mon[35514]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T07:59:09.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:08 smithi102 ceph-mon[35514]: pgmap v310: 97 pgs: 97 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:59:10.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T07:59:10.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:10 smithi102 ceph-mon[35514]: pgmap v311: 97 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 86 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:59:10.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:10 smithi159 ceph-mon[35522]: pgmap v311: 97 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 86 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:59:10.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.454+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1165551568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ef0100480 msgr2=0x7f0ef010e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:10.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.454+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1165551568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ef0100480 0x7f0ef010e9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009890 tx=0x7f0eec02a370 comp rx=0 tx=0).stop 2024-09-10T07:59:10.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.454+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1165551568 shutdown_connections 2024-09-10T07:59:10.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.454+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1165551568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ef0100480 0x7f0ef010e9a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.454+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1165551568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef00ffae0 0x7f0ef00fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.454+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1165551568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef0106b10 0x7f0ef0106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.454+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1165551568 >> 172.21.15.73:0/1165551568 conn(0x7f0ef00fba30 msgr2=0x7f0ef00fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:10.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.454+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1165551568 shutdown_connections 2024-09-10T07:59:10.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.455+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1165551568 wait complete. 2024-09-10T07:59:10.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.455+0000 7f0ef82d7640 1 Processor -- start 2024-09-10T07:59:10.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef82d7640 1 -- start start 2024-09-10T07:59:10.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef82d7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ef00ffae0 0x7f0ef019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:10.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef82d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef0100480 0x7f0ef019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:10.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef82d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef0106b10 0x7f0ef010dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:10.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef82d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0111f20 con 0x7f0ef0106b10 2024-09-10T07:59:10.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef82d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0111da0 con 0x7f0ef0100480 2024-09-10T07:59:10.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef82d7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01120a0 con 0x7f0ef00ffae0 2024-09-10T07:59:10.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef6874640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef0106b10 0x7f0ef010dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef6874640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef0106b10 0x7f0ef010dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57598/0 (socket says 172.21.15.73:57598) 2024-09-10T07:59:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.456+0000 7f0ef6874640 1 -- 172.21.15.73:0/1588034839 learned_addr learned my addr 172.21.15.73:0/1588034839 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ef6874640 1 -- 172.21.15.73:0/1588034839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ef00ffae0 msgr2=0x7f0ef019efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ef6073640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ef00ffae0 0x7f0ef019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ef6874640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ef00ffae0 0x7f0ef019efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ef6874640 1 -- 172.21.15.73:0/1588034839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef0100480 msgr2=0x7f0ef019f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ef6874640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef0100480 0x7f0ef019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ef6874640 1 -- 172.21.15.73:0/1588034839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef010e390 con 0x7f0ef0106b10 2024-09-10T07:59:10.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ef6874640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef0106b10 0x7f0ef010dad0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009860 tx=0x7f0eec033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:10.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ee77fe640 1 -- 172.21.15.73:0/1588034839 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec037070 con 0x7f0ef0106b10 2024-09-10T07:59:10.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef010e620 con 0x7f0ef0106b10 2024-09-10T07:59:10.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef019abf0 con 0x7f0ef0106b10 2024-09-10T07:59:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ee77fe640 1 -- 172.21.15.73:0/1588034839 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0eec041070 con 0x7f0ef0106b10 2024-09-10T07:59:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.457+0000 7f0ee77fe640 1 -- 172.21.15.73:0/1588034839 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec005650 con 0x7f0ef0106b10 2024-09-10T07:59:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.459+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed4005290 con 0x7f0ef0106b10 2024-09-10T07:59:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.461+0000 7f0ee77fe640 1 -- 172.21.15.73:0/1588034839 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0eec004030 con 0x7f0ef0106b10 2024-09-10T07:59:10.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.461+0000 7f0ee77fe640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0edc0a2e20 0x7f0edc0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:10.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.461+0000 7f0ee77fe640 1 -- 172.21.15.73:0/1588034839 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8716+0+0 (secure 0 0 0) 0x7f0eec0ef550 con 0x7f0ef0106b10 2024-09-10T07:59:10.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.462+0000 7f0ef6073640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0edc0a2e20 0x7f0edc0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:10.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.463+0000 7f0ef6073640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0edc0a2e20 0x7f0edc0a52e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8005fd0 tx=0x7f0ee80095c0 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:10.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.468+0000 7f0ee77fe640 1 -- 172.21.15.73:0/1588034839 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0eec04a020 con 0x7f0ef0106b10 2024-09-10T07:59:10.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:10 smithi073 ceph-mon[30850]: pgmap v311: 97 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 86 active+clean; 17 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:59:10.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.803+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 --> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f0ed4000bc0 con 0x7f0edc0a2e20 2024-09-10T07:59:10.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.838+0000 7f0ee77fe640 1 -- 172.21.15.73:0/1588034839 <== mgr.15066 v2:172.21.15.73:6800/3122839464 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f0ed4000bc0 con 0x7f0edc0a2e20 2024-09-10T07:59:10.837 INFO:teuthology.orchestra.run.smithi073.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T07:49:09", "first": "2024-09-10T07:50:00", "last": "2024-09-10T07:59:00", "last_pruned": "2024-09-10T07:59:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-10T07:59:10.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0edc0a2e20 msgr2=0x7f0edc0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:10.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0edc0a2e20 0x7f0edc0a52e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8005fd0 tx=0x7f0ee80095c0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef0106b10 msgr2=0x7f0ef010dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef0106b10 0x7f0ef010dad0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009860 tx=0x7f0eec033d90 comp rx=0 tx=0).stop 2024-09-10T07:59:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 shutdown_connections 2024-09-10T07:59:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0edc0a2e20 0x7f0edc0a52e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef0106b10 0x7f0ef010dad0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef0100480 0x7f0ef019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 --2- 172.21.15.73:0/1588034839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ef00ffae0 0x7f0ef019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:10.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 >> 172.21.15.73:0/1588034839 conn(0x7f0ef00fba30 msgr2=0x7f0ef00fc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 shutdown_connections 2024-09-10T07:59:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:10.841+0000 7f0ef82d7640 1 -- 172.21.15.73:0/1588034839 wait complete. 2024-09-10T07:59:10.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T07:59:11.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.026+0000 7f4c593e8640 1 -- 172.21.15.73:0/1998837647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c5406de60 msgr2=0x7f4c5410d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.026+0000 7f4c593e8640 1 --2- 172.21.15.73:0/1998837647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c5406de60 0x7f4c5410d230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009900 tx=0x7f4c4802a410 comp rx=0 tx=0).stop 2024-09-10T07:59:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.026+0000 7f4c593e8640 1 -- 172.21.15.73:0/1998837647 shutdown_connections 2024-09-10T07:59:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.026+0000 7f4c593e8640 1 --2- 172.21.15.73:0/1998837647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c54113450 0x7f4c54115840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.026+0000 7f4c593e8640 1 --2- 172.21.15.73:0/1998837647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c5410ee40 0x7f4c5410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.026+0000 7f4c593e8640 1 --2- 172.21.15.73:0/1998837647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c5406de60 0x7f4c5410d230 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009900 tx=0x7f4c4802a410 comp rx=0 tx=0).stop 2024-09-10T07:59:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.026+0000 7f4c593e8640 1 -- 172.21.15.73:0/1998837647 >> 172.21.15.73:0/1998837647 conn(0x7f4c5406ce00 msgr2=0x7f4c5406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:11.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.030+0000 7f4c593e8640 1 -- 172.21.15.73:0/1998837647 shutdown_connections 2024-09-10T07:59:11.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.031+0000 7f4c593e8640 1 -- 172.21.15.73:0/1998837647 wait complete. 2024-09-10T07:59:11.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.032+0000 7f4c593e8640 1 Processor -- start 2024-09-10T07:59:11.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.035+0000 7f4c593e8640 1 -- start start 2024-09-10T07:59:11.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.035+0000 7f4c593e8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c5410ee40 0x7f4c54116f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.035+0000 7f4c593e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c54113450 0x7f4c541174a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.035+0000 7f4c593e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c54118c00 0x7f4c541179e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.035+0000 7f4c593e8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5411a740 con 0x7f4c5410ee40 2024-09-10T07:59:11.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.035+0000 7f4c593e8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5411a5c0 con 0x7f4c54113450 2024-09-10T07:59:11.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.035+0000 7f4c593e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5411a8c0 con 0x7f4c54118c00 2024-09-10T07:59:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.037+0000 7f4c537fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c54118c00 0x7f4c541179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.037+0000 7f4c537fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c54118c00 0x7f4c541179e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.73:48136/0 (socket says 172.21.15.73:48136) 2024-09-10T07:59:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.037+0000 7f4c537fe640 1 -- 172.21.15.73:0/3791997533 learned_addr learned my addr 172.21.15.73:0/3791997533 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:11.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.037+0000 7f4c527fc640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c54113450 0x7f4c541174a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:11.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.039+0000 7f4c537fe640 1 -- 172.21.15.73:0/3791997533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c54113450 msgr2=0x7f4c541174a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.039+0000 7f4c537fe640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c54113450 0x7f4c541174a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.039+0000 7f4c537fe640 1 -- 172.21.15.73:0/3791997533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c5410ee40 msgr2=0x7f4c54116f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.039+0000 7f4c537fe640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c5410ee40 0x7f4c54116f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.039+0000 7f4c537fe640 1 -- 172.21.15.73:0/3791997533 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c541a5060 con 0x7f4c54118c00 2024-09-10T07:59:11.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.040+0000 7f4c537fe640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c54118c00 0x7f4c541179e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00e9d0 tx=0x7f4c4c00ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.041+0000 7f4c3bfff640 1 -- 172.21.15.73:0/3791997533 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00cd80 con 0x7f4c54118c00 2024-09-10T07:59:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.041+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c541a5350 con 0x7f4c54118c00 2024-09-10T07:59:11.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.041+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c541a58a0 con 0x7f4c54118c00 2024-09-10T07:59:11.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.042+0000 7f4c3bfff640 1 -- 172.21.15.73:0/3791997533 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c4c005020 con 0x7f4c54118c00 2024-09-10T07:59:11.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.042+0000 7f4c3bfff640 1 -- 172.21.15.73:0/3791997533 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0116d0 con 0x7f4c54118c00 2024-09-10T07:59:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.044+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c40005290 con 0x7f4c54118c00 2024-09-10T07:59:11.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.052+0000 7f4c3bfff640 1 -- 172.21.15.73:0/3791997533 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4c4c004a40 con 0x7f4c54118c00 2024-09-10T07:59:11.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.053+0000 7f4c3bfff640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4c3c0a2fd0 0x7f4c3c0a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.053+0000 7f4c3bfff640 1 -- 172.21.15.73:0/3791997533 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8716+0+0 (secure 0 0 0) 0x7f4c4c0cf9b0 con 0x7f4c54118c00 2024-09-10T07:59:11.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.057+0000 7f4c52ffd640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4c3c0a2fd0 0x7f4c3c0a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:11.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.058+0000 7f4c52ffd640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4c3c0a2fd0 0x7f4c3c0a5490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009850 tx=0x7f4c48000bc0 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:11.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.061+0000 7f4c3bfff640 1 -- 172.21.15.73:0/3791997533 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c4c016030 con 0x7f4c54118c00 2024-09-10T07:59:11.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:11 smithi073 ceph-mon[30850]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:11.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:11 smithi102 ceph-mon[35514]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:11.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:11 smithi159 ceph-mon[35522]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:11.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.429+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 --> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f4c40000bc0 con 0x7f4c3c0a2fd0 2024-09-10T07:59:11.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.557+0000 7f4c3bfff640 1 -- 172.21.15.73:0/3791997533 <== mgr.15066 v2:172.21.15.73:6800/3122839464 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f4c40000bc0 con 0x7f4c3c0a2fd0 2024-09-10T07:59:11.556 INFO:teuthology.orchestra.run.smithi073.stdout:/ 1m 6m3h 2024-09-10T07:59:11.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4c3c0a2fd0 msgr2=0x7f4c3c0a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4c3c0a2fd0 0x7f4c3c0a5490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009850 tx=0x7f4c48000bc0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c54118c00 msgr2=0x7f4c541179e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c54118c00 0x7f4c541179e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00e9d0 tx=0x7f4c4c00ee90 comp rx=0 tx=0).stop 2024-09-10T07:59:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 shutdown_connections 2024-09-10T07:59:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f4c3c0a2fd0 0x7f4c3c0a5490 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c54118c00 0x7f4c541179e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c54113450 0x7f4c541174a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 --2- 172.21.15.73:0/3791997533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c5410ee40 0x7f4c54116f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 >> 172.21.15.73:0/3791997533 conn(0x7f4c5406ce00 msgr2=0x7f4c54072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:11.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 shutdown_connections 2024-09-10T07:59:11.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.560+0000 7f4c593e8640 1 -- 172.21.15.73:0/3791997533 wait complete. 2024-09-10T07:59:11.576 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T07:59:11.588 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:59:11.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.754+0000 7f27994a6640 1 -- 172.21.15.73:0/3075526168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2794107aa0 msgr2=0x7f2794107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.754+0000 7f27994a6640 1 --2- 172.21.15.73:0/3075526168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2794107aa0 0x7f2794107e80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2784009930 tx=0x7f278402a440 comp rx=0 tx=0).stop 2024-09-10T07:59:11.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.754+0000 7f27994a6640 1 -- 172.21.15.73:0/3075526168 shutdown_connections 2024-09-10T07:59:11.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.754+0000 7f27994a6640 1 --2- 172.21.15.73:0/3075526168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2794102430 0x7f279410e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.755+0000 7f27994a6640 1 --2- 172.21.15.73:0/3075526168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2794101a90 0x7f2794101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.755+0000 7f27994a6640 1 --2- 172.21.15.73:0/3075526168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2794107aa0 0x7f2794107e80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.755+0000 7f27994a6640 1 -- 172.21.15.73:0/3075526168 >> 172.21.15.73:0/3075526168 conn(0x7f27940fd7d0 msgr2=0x7f27940ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:11.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.755+0000 7f27994a6640 1 -- 172.21.15.73:0/3075526168 shutdown_connections 2024-09-10T07:59:11.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.755+0000 7f27994a6640 1 -- 172.21.15.73:0/3075526168 wait complete. 2024-09-10T07:59:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.756+0000 7f27994a6640 1 Processor -- start 2024-09-10T07:59:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.756+0000 7f27994a6640 1 -- start start 2024-09-10T07:59:11.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f27994a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2794101a90 0x7f27941984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f27994a6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2794102430 0x7f27941989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f27994a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2794107aa0 0x7f279419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f27994a6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2794111f30 con 0x7f2794107aa0 2024-09-10T07:59:11.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f2792ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2794101a90 0x7f27941984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:11.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f2792ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2794101a90 0x7f27941984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.73:42424/0 (socket says 172.21.15.73:42424) 2024-09-10T07:59:11.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f2792ffd640 1 -- 172.21.15.73:0/1148565889 learned_addr learned my addr 172.21.15.73:0/1148565889 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:11.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f27927fc640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2794102430 0x7f27941989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:11.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2794111db0 con 0x7f2794101a90 2024-09-10T07:59:11.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f27941120b0 con 0x7f2794102430 2024-09-10T07:59:11.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.757+0000 7f27937fe640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2794107aa0 0x7f279419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:11.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.758+0000 7f2792ffd640 1 -- 172.21.15.73:0/1148565889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2794102430 msgr2=0x7f27941989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.758+0000 7f2792ffd640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2794102430 0x7f27941989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.758+0000 7f2792ffd640 1 -- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2794107aa0 msgr2=0x7f279419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.758+0000 7f2792ffd640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2794107aa0 0x7f279419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.758+0000 7f2792ffd640 1 -- 172.21.15.73:0/1148565889 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279419d490 con 0x7f2794101a90 2024-09-10T07:59:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.758+0000 7f2792ffd640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2794101a90 0x7f27941984a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f278402a960 tx=0x7f2784003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.758+0000 7f277bfff640 1 -- 172.21.15.73:0/1148565889 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278403f070 con 0x7f2794101a90 2024-09-10T07:59:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.759+0000 7f277bfff640 1 -- 172.21.15.73:0/1148565889 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2784031c90 con 0x7f2794101a90 2024-09-10T07:59:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.759+0000 7f277bfff640 1 -- 172.21.15.73:0/1148565889 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784035030 con 0x7f2794101a90 2024-09-10T07:59:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.759+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279419d720 con 0x7f2794101a90 2024-09-10T07:59:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.759+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279419db00 con 0x7f2794101a90 2024-09-10T07:59:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.760+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2794101ef0 con 0x7f2794101a90 2024-09-10T07:59:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.763+0000 7f277bfff640 1 -- 172.21.15.73:0/1148565889 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2784042070 con 0x7f2794101a90 2024-09-10T07:59:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.763+0000 7f277bfff640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f277c0a2e00 0x7f277c0a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.764+0000 7f277bfff640 1 -- 172.21.15.73:0/1148565889 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8716+0+0 (secure 0 0 0) 0x7f27840efba0 con 0x7f2794101a90 2024-09-10T07:59:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.764+0000 7f27927fc640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f277c0a2e00 0x7f277c0a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.765+0000 7f27927fc640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f277c0a2e00 0x7f277c0a52c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27940ffe60 tx=0x7f278c00d040 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:11.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:11.771+0000 7f277bfff640 1 -- 172.21.15.73:0/1148565889 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27840bc050 con 0x7f2794101a90 2024-09-10T07:59:12.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.103+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2794109a70 con 0x7f2794101a90 2024-09-10T07:59:12.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.105+0000 7f277bfff640 1 -- 172.21.15.73:0/1148565889 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+23546 (secure 0 0 0) 0x7f27840c0350 con 0x7f2794101a90 2024-09-10T07:59:12.105 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:59:12.105 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":93,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:59:07.625495+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:47:28.792230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:47:30.666653+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/3362975109":"2024-09-11T07:49:07.755656+0000","172.21.15.73:6801/662943870":"2024-09-11T07:49:07.755656+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1757694921":"2024-09-11T07:49:07.755656+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1430464896":"2024-09-11T07:49:07.755656+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/662943870":"2024-09-11T07:49:07.755656+0000","172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/2752680748":"2024-09-11T07:49:07.755656+0000","172.21.15.73:0/643669867":"2024-09-11T07:49:07.755656+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:59:12.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f277c0a2e00 msgr2=0x7f277c0a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f277c0a2e00 0x7f277c0a52c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27940ffe60 tx=0x7f278c00d040 comp rx=0 tx=0).stop 2024-09-10T07:59:12.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2794101a90 msgr2=0x7f27941984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2794101a90 0x7f27941984a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f278402a960 tx=0x7f2784003b90 comp rx=0 tx=0).stop 2024-09-10T07:59:12.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 shutdown_connections 2024-09-10T07:59:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f277c0a2e00 0x7f277c0a52c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2794107aa0 0x7f279419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2794102430 0x7f27941989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 --2- 172.21.15.73:0/1148565889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2794101a90 0x7f27941984a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 >> 172.21.15.73:0/1148565889 conn(0x7f27940fd7d0 msgr2=0x7f27940fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 shutdown_connections 2024-09-10T07:59:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.109+0000 7f27994a6640 1 -- 172.21.15.73:0/1148565889 wait complete. 2024-09-10T07:59:12.125 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:42:58.876964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T07:47:28.792230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T07:47:30.666653+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:59:12.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:59:12.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.293+0000 7ffbaaba8640 1 -- 172.21.15.73:0/2749627161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4105f10 msgr2=0x7ffba41063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.293+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/2749627161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4105f10 0x7ffba41063c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c01ace0 tx=0x7ffb9c03ba00 comp rx=0 tx=0).stop 2024-09-10T07:59:12.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.293+0000 7ffbaaba8640 1 -- 172.21.15.73:0/2749627161 shutdown_connections 2024-09-10T07:59:12.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.293+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/2749627161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4105f10 0x7ffba41063c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.293+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/2749627161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba4101400 0x7ffba41058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.293+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/2749627161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffba4100ae0 0x7ffba4100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.293+0000 7ffbaaba8640 1 -- 172.21.15.73:0/2749627161 >> 172.21.15.73:0/2749627161 conn(0x7ffba40779d0 msgr2=0x7ffba40fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:12.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.294+0000 7ffbaaba8640 1 -- 172.21.15.73:0/2749627161 shutdown_connections 2024-09-10T07:59:12.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.294+0000 7ffbaaba8640 1 -- 172.21.15.73:0/2749627161 wait complete. 2024-09-10T07:59:12.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.294+0000 7ffbaaba8640 1 Processor -- start 2024-09-10T07:59:12.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffbaaba8640 1 -- start start 2024-09-10T07:59:12.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffbaaba8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba4100ae0 0x7ffba4114e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:12.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffbaaba8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4101400 0x7ffba4110f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffbaaba8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffba4105f10 0x7ffba4111440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffbaaba8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4109890 con 0x7ffba4100ae0 2024-09-10T07:59:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffbaaba8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4109710 con 0x7ffba4105f10 2024-09-10T07:59:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffbaaba8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4109a10 con 0x7ffba4101400 2024-09-10T07:59:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4101400 0x7ffba4110f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba9145640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffba4105f10 0x7ffba4111440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba9145640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffba4105f10 0x7ffba4111440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.73:42436/0 (socket says 172.21.15.73:42436) 2024-09-10T07:59:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4101400 0x7ffba4110f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.73:48160/0 (socket says 172.21.15.73:48160) 2024-09-10T07:59:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba9145640 1 -- 172.21.15.73:0/794542261 learned_addr learned my addr 172.21.15.73:0/794542261 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba8944640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba4100ae0 0x7ffba4114e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba3fff640 1 -- 172.21.15.73:0/794542261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffba4105f10 msgr2=0x7ffba4111440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba3fff640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffba4105f10 0x7ffba4111440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba3fff640 1 -- 172.21.15.73:0/794542261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba4100ae0 msgr2=0x7ffba4114e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba3fff640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba4100ae0 0x7ffba4114e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.295+0000 7ffba3fff640 1 -- 172.21.15.73:0/794542261 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba4111b70 con 0x7ffba4101400 2024-09-10T07:59:12.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.296+0000 7ffba3fff640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4101400 0x7ffba4110f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800e9f0 tx=0x7ffb9800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:12.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.296+0000 7ffba1ffb640 1 -- 172.21.15.73:0/794542261 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9800ccc0 con 0x7ffba4101400 2024-09-10T07:59:12.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.296+0000 7ffba1ffb640 1 -- 172.21.15.73:0/794542261 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb98010910 con 0x7ffba4101400 2024-09-10T07:59:12.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.297+0000 7ffba1ffb640 1 -- 172.21.15.73:0/794542261 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98018790 con 0x7ffba4101400 2024-09-10T07:59:12.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.297+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba41a2890 con 0x7ffba4101400 2024-09-10T07:59:12.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.298+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba41a2d00 con 0x7ffba4101400 2024-09-10T07:59:12.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.299+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba4069bc0 con 0x7ffba4101400 2024-09-10T07:59:12.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.301+0000 7ffba1ffb640 1 -- 172.21.15.73:0/794542261 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ffb9801f020 con 0x7ffba4101400 2024-09-10T07:59:12.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.302+0000 7ffba1ffb640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ffb8c0a2be0 0x7ffb8c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:12.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.302+0000 7ffba1ffb640 1 -- 172.21.15.73:0/794542261 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8716+0+0 (secure 0 0 0) 0x7ffb980cfab0 con 0x7ffba4101400 2024-09-10T07:59:12.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.304+0000 7ffba8944640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ffb8c0a2be0 0x7ffb8c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:12.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.305+0000 7ffba8944640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ffb8c0a2be0 0x7ffb8c0a50a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009990 tx=0x7ffb94009110 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:12.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.306+0000 7ffba1ffb640 1 -- 172.21.15.73:0/794542261 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb9809c5b0 con 0x7ffba4101400 2024-09-10T07:59:12.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:12 smithi102 ceph-mon[35514]: from='client.24832 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:12.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:12 smithi102 ceph-mon[35514]: pgmap v312: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 16 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:59:12.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:12 smithi159 ceph-mon[35522]: from='client.24832 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:12.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:12 smithi159 ceph-mon[35522]: pgmap v312: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 16 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:59:12.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:12 smithi073 ceph-mon[30850]: from='client.24832 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:12.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:12 smithi073 ceph-mon[30850]: pgmap v312: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 16 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-10T07:59:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.612+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffba4112430 con 0x7ffba4101400 2024-09-10T07:59:12.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.613+0000 7ffba1ffb640 1 -- 172.21.15.73:0/794542261 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7ffb9809beb0 con 0x7ffba4101400 2024-09-10T07:59:12.612 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-10T07:59:12.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ffb8c0a2be0 msgr2=0x7ffb8c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ffb8c0a2be0 0x7ffb8c0a50a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009990 tx=0x7ffb94009110 comp rx=0 tx=0).stop 2024-09-10T07:59:12.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4101400 msgr2=0x7ffba4110f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4101400 0x7ffba4110f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800e9f0 tx=0x7ffb9800edf0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 shutdown_connections 2024-09-10T07:59:12.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ffb8c0a2be0 0x7ffb8c0a50a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffba4105f10 0x7ffba4111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffba4101400 0x7ffba4110f00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 --2- 172.21.15.73:0/794542261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba4100ae0 0x7ffba4114e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 >> 172.21.15.73:0/794542261 conn(0x7ffba40779d0 msgr2=0x7ffba4103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:12.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 shutdown_connections 2024-09-10T07:59:12.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.615+0000 7ffbaaba8640 1 -- 172.21.15.73:0/794542261 wait complete. 2024-09-10T07:59:12.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T07:59:12.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.745+0000 7ff792c8d640 1 -- 172.21.15.73:0/2881908845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 msgr2=0x7ff78c100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.745+0000 7ff792c8d640 1 --2- 172.21.15.73:0/2881908845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 0x7ff78c100e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff778009930 tx=0x7ff77802a420 comp rx=0 tx=0).stop 2024-09-10T07:59:12.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.745+0000 7ff792c8d640 1 -- 172.21.15.73:0/2881908845 shutdown_connections 2024-09-10T07:59:12.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.745+0000 7ff792c8d640 1 --2- 172.21.15.73:0/2881908845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff78c1013c0 0x7ff78c10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.745+0000 7ff792c8d640 1 --2- 172.21.15.73:0/2881908845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 0x7ff78c100e80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.745+0000 7ff792c8d640 1 --2- 172.21.15.73:0/2881908845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff78c106a30 0x7ff78c106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.745+0000 7ff792c8d640 1 -- 172.21.15.73:0/2881908845 >> 172.21.15.73:0/2881908845 conn(0x7ff78c0fc740 msgr2=0x7ff78c0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:12.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.745+0000 7ff792c8d640 1 -- 172.21.15.73:0/2881908845 shutdown_connections 2024-09-10T07:59:12.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.745+0000 7ff792c8d640 1 -- 172.21.15.73:0/2881908845 wait complete. 2024-09-10T07:59:12.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.746+0000 7ff792c8d640 1 Processor -- start 2024-09-10T07:59:12.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.746+0000 7ff792c8d640 1 -- start start 2024-09-10T07:59:12.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.746+0000 7ff792c8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 0x7ff78c197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:12.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.746+0000 7ff792c8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff78c1013c0 0x7ff78c197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:12.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff792c8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff78c106a30 0x7ff78c19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:12.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff792c8d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c110e70 con 0x7ff78c100a20 2024-09-10T07:59:12.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff792c8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c110cf0 con 0x7ff78c1013c0 2024-09-10T07:59:12.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff792c8d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c110ff0 con 0x7ff78c106a30 2024-09-10T07:59:12.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff790a29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 0x7ff78c197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:12.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff790a29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 0x7ff78c197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57670/0 (socket says 172.21.15.73:57670) 2024-09-10T07:59:12.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff790a29640 1 -- 172.21.15.73:0/586812620 learned_addr learned my addr 172.21.15.73:0/586812620 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:12.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff78bfff640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff78c1013c0 0x7ff78c197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:12.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff79122a640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff78c106a30 0x7ff78c19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:12.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff790a29640 1 -- 172.21.15.73:0/586812620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff78c106a30 msgr2=0x7ff78c19bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff790a29640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff78c106a30 0x7ff78c19bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff790a29640 1 -- 172.21.15.73:0/586812620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff78c1013c0 msgr2=0x7ff78c197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff790a29640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff78c1013c0 0x7ff78c197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff790a29640 1 -- 172.21.15.73:0/586812620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c19c3f0 con 0x7ff78c100a20 2024-09-10T07:59:12.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff790a29640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 0x7ff78c197400 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff78000eb00 tx=0x7ff780009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:12.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff789ffb640 1 -- 172.21.15.73:0/586812620 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78001c070 con 0x7ff78c100a20 2024-09-10T07:59:12.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.747+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78c19c6e0 con 0x7ff78c100a20 2024-09-10T07:59:12.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.748+0000 7ff789ffb640 1 -- 172.21.15.73:0/586812620 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff78000bc30 con 0x7ff78c100a20 2024-09-10T07:59:12.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.748+0000 7ff789ffb640 1 -- 172.21.15.73:0/586812620 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800166a0 con 0x7ff78c100a20 2024-09-10T07:59:12.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.748+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78c06a300 con 0x7ff78c100a20 2024-09-10T07:59:12.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.749+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff78c100e80 con 0x7ff78c100a20 2024-09-10T07:59:12.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.751+0000 7ff789ffb640 1 -- 172.21.15.73:0/586812620 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff78001f070 con 0x7ff78c100a20 2024-09-10T07:59:12.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.752+0000 7ff789ffb640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff77c0a2d80 0x7ff77c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:12.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.752+0000 7ff78bfff640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff77c0a2d80 0x7ff77c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:12.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.752+0000 7ff789ffb640 1 -- 172.21.15.73:0/586812620 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8716+0+0 (secure 0 0 0) 0x7ff7800d0ee0 con 0x7ff78c100a20 2024-09-10T07:59:12.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.753+0000 7ff78bfff640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff77c0a2d80 0x7ff77c0a5240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff778009900 tx=0x7ff7780058d0 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:12.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.756+0000 7ff789ffb640 1 -- 172.21.15.73:0/586812620 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff78000bde0 con 0x7ff78c100a20 2024-09-10T07:59:12.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.961+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff78c06ade0 con 0x7ff78c100a20 2024-09-10T07:59:12.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.961+0000 7ff789ffb640 1 -- 172.21.15.73:0/586812620 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7ff78009d3f0 con 0x7ff78c100a20 2024-09-10T07:59:12.961 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-09-10T07:59:12.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff77c0a2d80 msgr2=0x7ff77c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff77c0a2d80 0x7ff77c0a5240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff778009900 tx=0x7ff7780058d0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 msgr2=0x7ff78c197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:12.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 0x7ff78c197400 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff78000eb00 tx=0x7ff780009f20 comp rx=0 tx=0).stop 2024-09-10T07:59:12.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 shutdown_connections 2024-09-10T07:59:12.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff77c0a2d80 0x7ff77c0a5240 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff78c106a30 0x7ff78c19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff78c1013c0 0x7ff78c197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 --2- 172.21.15.73:0/586812620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff78c100a20 0x7ff78c197400 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:12.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.963+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 >> 172.21.15.73:0/586812620 conn(0x7ff78c0fc740 msgr2=0x7ff78c0fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:12.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.964+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 shutdown_connections 2024-09-10T07:59:12.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:12.964+0000 7ff792c8d640 1 -- 172.21.15.73:0/586812620 wait complete. 2024-09-10T07:59:12.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T07:59:13.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 -- 172.21.15.73:0/960755281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730101a90 msgr2=0x7f6730101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 --2- 172.21.15.73:0/960755281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730101a90 0x7f6730101ef0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6718009930 tx=0x7f671802a420 comp rx=0 tx=0).stop 2024-09-10T07:59:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 -- 172.21.15.73:0/960755281 shutdown_connections 2024-09-10T07:59:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 --2- 172.21.15.73:0/960755281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6730102430 0x7f673010e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 --2- 172.21.15.73:0/960755281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730101a90 0x7f6730101ef0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 --2- 172.21.15.73:0/960755281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6730107aa0 0x7f6730107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 -- 172.21.15.73:0/960755281 >> 172.21.15.73:0/960755281 conn(0x7f67300fd7d0 msgr2=0x7f67300ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 -- 172.21.15.73:0/960755281 shutdown_connections 2024-09-10T07:59:13.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 -- 172.21.15.73:0/960755281 wait complete. 2024-09-10T07:59:13.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.080+0000 7f6735bc4640 1 Processor -- start 2024-09-10T07:59:13.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f6735bc4640 1 -- start start 2024-09-10T07:59:13.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f6735bc4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6730101a90 0x7f6730198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:13.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f6735bc4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6730102430 0x7f6730198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:13.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f6735bc4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730107aa0 0x7f673019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:13.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f6735bc4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6730111ee0 con 0x7f6730107aa0 2024-09-10T07:59:13.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f6735bc4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6730111d60 con 0x7f6730102430 2024-09-10T07:59:13.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f6735bc4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6730112060 con 0x7f6730101a90 2024-09-10T07:59:13.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730107aa0 0x7f673019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:13.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730107aa0 0x7f673019ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57690/0 (socket says 172.21.15.73:57690) 2024-09-10T07:59:13.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672ffff640 1 -- 172.21.15.73:0/1202268679 learned_addr learned my addr 172.21.15.73:0/1202268679 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:13.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672effd640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6730102430 0x7f6730198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:13.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672f7fe640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6730101a90 0x7f6730198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:13.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672ffff640 1 -- 172.21.15.73:0/1202268679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6730101a90 msgr2=0x7f6730198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:13.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672ffff640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6730101a90 0x7f6730198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672ffff640 1 -- 172.21.15.73:0/1202268679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6730102430 msgr2=0x7f6730198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:13.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672ffff640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6730102430 0x7f6730198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672ffff640 1 -- 172.21.15.73:0/1202268679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673019d420 con 0x7f6730107aa0 2024-09-10T07:59:13.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672ffff640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730107aa0 0x7f673019ccf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f672800eb10 tx=0x7f672800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:13.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672cff9640 1 -- 172.21.15.73:0/1202268679 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728004b20 con 0x7f6730107aa0 2024-09-10T07:59:13.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f672cff9640 1 -- 172.21.15.73:0/1202268679 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6728004cc0 con 0x7f6730107aa0 2024-09-10T07:59:13.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.081+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673019d710 con 0x7f6730107aa0 2024-09-10T07:59:13.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.082+0000 7f672cff9640 1 -- 172.21.15.73:0/1202268679 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728010760 con 0x7f6730107aa0 2024-09-10T07:59:13.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.082+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67301a4fa0 con 0x7f6730107aa0 2024-09-10T07:59:13.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.082+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6730101ef0 con 0x7f6730107aa0 2024-09-10T07:59:13.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.084+0000 7f672cff9640 1 -- 172.21.15.73:0/1202268679 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6728005020 con 0x7f6730107aa0 2024-09-10T07:59:13.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.085+0000 7f672cff9640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f671c0a2d00 0x7f671c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:13.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.085+0000 7f672f7fe640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f671c0a2d00 0x7f671c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:13.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.085+0000 7f672cff9640 1 -- 172.21.15.73:0/1202268679 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8716+0+0 (secure 0 0 0) 0x7f67280cfc10 con 0x7f6730107aa0 2024-09-10T07:59:13.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.085+0000 7f672f7fe640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f671c0a2d00 0x7f671c0a51c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6720009b50 tx=0x7f6720005f90 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:13.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.089+0000 7f672cff9640 1 -- 172.21.15.73:0/1202268679 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f672809c710 con 0x7f6730107aa0 2024-09-10T07:59:13.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.263+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f673002d7c0 con 0x7f6730107aa0 2024-09-10T07:59:13.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.264+0000 7f672cff9640 1 -- 172.21.15.73:0/1202268679 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f67280bc0d0 con 0x7f6730107aa0 2024-09-10T07:59:13.263 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-09-10T07:59:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f671c0a2d00 msgr2=0x7f671c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f671c0a2d00 0x7f671c0a51c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6720009b50 tx=0x7f6720005f90 comp rx=0 tx=0).stop 2024-09-10T07:59:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730107aa0 msgr2=0x7f673019ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730107aa0 0x7f673019ccf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f672800eb10 tx=0x7f672800c2d0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 shutdown_connections 2024-09-10T07:59:13.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f671c0a2d00 0x7f671c0a51c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6730107aa0 0x7f673019ccf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6730102430 0x7f6730198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 --2- 172.21.15.73:0/1202268679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6730101a90 0x7f6730198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.265+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 >> 172.21.15.73:0/1202268679 conn(0x7f67300fd7d0 msgr2=0x7f67300fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:13.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.266+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 shutdown_connections 2024-09-10T07:59:13.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.266+0000 7f6735bc4640 1 -- 172.21.15.73:0/1202268679 wait complete. 2024-09-10T07:59:13.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:13 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1148565889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:59:13.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:13 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/794542261' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T07:59:13.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:13 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/586812620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T07:59:13.276 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T07:59:13.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:13 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1148565889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:59:13.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:13 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/794542261' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T07:59:13.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:13 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/586812620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T07:59:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.378+0000 7fd74ccba640 1 -- 172.21.15.73:0/3473642665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 msgr2=0x7fd748100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.378+0000 7fd74ccba640 1 --2- 172.21.15.73:0/3473642665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 0x7fd748100de0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009cd0 tx=0x7fd73c02a8e0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.378+0000 7fd74ccba640 1 -- 172.21.15.73:0/3473642665 shutdown_connections 2024-09-10T07:59:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.378+0000 7fd74ccba640 1 --2- 172.21.15.73:0/3473642665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748101320 0x7fd74810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.378+0000 7fd74ccba640 1 --2- 172.21.15.73:0/3473642665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 0x7fd748100de0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.378+0000 7fd74ccba640 1 --2- 172.21.15.73:0/3473642665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd748106990 0x7fd748106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.378+0000 7fd74ccba640 1 -- 172.21.15.73:0/3473642665 >> 172.21.15.73:0/3473642665 conn(0x7fd748077a10 msgr2=0x7fd7480fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.378+0000 7fd74ccba640 1 -- 172.21.15.73:0/3473642665 shutdown_connections 2024-09-10T07:59:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.378+0000 7fd74ccba640 1 -- 172.21.15.73:0/3473642665 wait complete. 2024-09-10T07:59:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74ccba640 1 Processor -- start 2024-09-10T07:59:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74ccba640 1 -- start start 2024-09-10T07:59:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74ccba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 0x7fd748197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74ccba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748101320 0x7fd748197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74ccba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd748106990 0x7fd74819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74ccba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd748110dd0 con 0x7fd748100980 2024-09-10T07:59:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74ccba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd748110c50 con 0x7fd748101320 2024-09-10T07:59:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74ccba640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd748110f50 con 0x7fd748106990 2024-09-10T07:59:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 0x7fd748197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 0x7fd748197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57710/0 (socket says 172.21.15.73:57710) 2024-09-10T07:59:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74659c640 1 -- 172.21.15.73:0/131904516 learned_addr learned my addr 172.21.15.73:0/131904516 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd745d9b640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748101320 0x7fd748197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd746d9d640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd748106990 0x7fd74819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74659c640 1 -- 172.21.15.73:0/131904516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd748106990 msgr2=0x7fd74819bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74659c640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd748106990 0x7fd74819bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74659c640 1 -- 172.21.15.73:0/131904516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748101320 msgr2=0x7fd748197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74659c640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748101320 0x7fd748197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74659c640 1 -- 172.21.15.73:0/131904516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74819c310 con 0x7fd748100980 2024-09-10T07:59:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd74659c640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 0x7fd748197320 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd74000eb00 tx=0x7fd74000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.379+0000 7fd7377fe640 1 -- 172.21.15.73:0/131904516 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74000bc30 con 0x7fd748100980 2024-09-10T07:59:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.380+0000 7fd7377fe640 1 -- 172.21.15.73:0/131904516 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd74000bdd0 con 0x7fd748100980 2024-09-10T07:59:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.380+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74819c600 con 0x7fd748100980 2024-09-10T07:59:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.380+0000 7fd7377fe640 1 -- 172.21.15.73:0/131904516 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd740017410 con 0x7fd748100980 2024-09-10T07:59:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.380+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd748069380 con 0x7fd748100980 2024-09-10T07:59:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.380+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7481020c0 con 0x7fd748100980 2024-09-10T07:59:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.382+0000 7fd7377fe640 1 -- 172.21.15.73:0/131904516 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd740005000 con 0x7fd748100980 2024-09-10T07:59:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.382+0000 7fd7377fe640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fd7300a2d00 0x7fd7300a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.382+0000 7fd745d9b640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fd7300a2d00 0x7fd7300a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.382+0000 7fd7377fe640 1 -- 172.21.15.73:0/131904516 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8716+0+0 (secure 0 0 0) 0x7fd7400d11f0 con 0x7fd748100980 2024-09-10T07:59:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.383+0000 7fd745d9b640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fd7300a2d00 0x7fd7300a51c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd73c006010 tx=0x7fd73c009360 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.386+0000 7fd7377fe640 1 -- 172.21.15.73:0/131904516 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd74009d700 con 0x7fd748100980 2024-09-10T07:59:13.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:13 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1148565889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:59:13.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:13 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/794542261' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T07:59:13.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:13 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/586812620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T07:59:13.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.609+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fd748069da0 con 0x7fd748100980 2024-09-10T07:59:13.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.617+0000 7fd7377fe640 1 -- 172.21.15.73:0/131904516 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740901 (secure 0 0 0) 0x7fd7400a1a00 con 0x7fd748100980 2024-09-10T07:59:13.627 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:59:13.627 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T07:59:13.627 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 25, 2024-09-10T07:59:13.627 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.627 INFO:teuthology.orchestra.run.smithi073.stdout: "active_gid": 15066, 2024-09-10T07:59:13.627 INFO:teuthology.orchestra.run.smithi073.stdout: "active_name": "x", 2024-09-10T07:59:13.628 INFO:teuthology.orchestra.run.smithi073.stdout: "active_addrs": { 2024-09-10T07:59:13.628 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-10T07:59:13.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.628 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-10T07:59:13.628 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6800", 2024-09-10T07:59:13.628 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3122839464 2024-09-10T07:59:13.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.629 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-10T07:59:13.629 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6801", 2024-09-10T07:59:13.629 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3122839464 2024-09-10T07:59:13.629 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.629 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:13.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.630 INFO:teuthology.orchestra.run.smithi073.stdout: "active_addr": "172.21.15.73:6801/3122839464", 2024-09-10T07:59:13.630 INFO:teuthology.orchestra.run.smithi073.stdout: "active_change": "2024-09-10T07:49:07.755869+0000", 2024-09-10T07:59:13.630 INFO:teuthology.orchestra.run.smithi073.stdout: "active_mgr_features": 4540701547738038271, 2024-09-10T07:59:13.630 INFO:teuthology.orchestra.run.smithi073.stdout: "available": true, 2024-09-10T07:59:13.630 INFO:teuthology.orchestra.run.smithi073.stdout: "standbys": [ 2024-09-10T07:59:13.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.631 INFO:teuthology.orchestra.run.smithi073.stdout: "gid": 24736, 2024-09-10T07:59:13.631 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "z", 2024-09-10T07:59:13.631 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_features": 4540701547738038271, 2024-09-10T07:59:13.631 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2024-09-10T07:59:13.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.631 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2024-09-10T07:59:13.631 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:13.632 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:13.632 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:13.632 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:13.632 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:13.632 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.632 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.632 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.633 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:13.633 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.633 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.633 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.633 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T07:59:13.633 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.633 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.634 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.634 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:13.634 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:13.634 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.634 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.635 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.635 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.635 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.635 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.635 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.635 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.635 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.635 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.636 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.636 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.636 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.636 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.636 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.636 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.636 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.637 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.637 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:13.637 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:13.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.637 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.638 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.638 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.638 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.638 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.638 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.638 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.638 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.639 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.639 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:13.639 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:13.639 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.639 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.639 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.639 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2024-09-10T07:59:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2024-09-10T07:59:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2024-09-10T07:59:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2024-09-10T07:59:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2024-09-10T07:59:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2024-09-10T07:59:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2024-09-10T07:59:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2024-09-10T07:59:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2024-09-10T07:59:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2024-09-10T07:59:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2024-09-10T07:59:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2024-09-10T07:59:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2024-09-10T07:59:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2024-09-10T07:59:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2024-09-10T07:59:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2024-09-10T07:59:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2024-09-10T07:59:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2024-09-10T07:59:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2024-09-10T07:59:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2024-09-10T07:59:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2024-09-10T07:59:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2024-09-10T07:59:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T07:59:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2024-09-10T07:59:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2024-09-10T07:59:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2024-09-10T07:59:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2024-09-10T07:59:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2024-09-10T07:59:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2024-09-10T07:59:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T07:59:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2024-09-10T07:59:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2024-09-10T07:59:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2024-09-10T07:59:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T07:59:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T07:59:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2024-09-10T07:59:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2024-09-10T07:59:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-10T07:59:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-10T07:59:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T07:59:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T07:59:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.666 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2024-09-10T07:59:13.666 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2024-09-10T07:59:13.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:13.666 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.666 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.666 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2024-09-10T07:59:13.667 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:13.667 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2024-09-10T07:59:13.667 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.667 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T07:59:13.667 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.667 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.667 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2024-09-10T07:59:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2024-09-10T07:59:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T07:59:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T07:59:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T07:59:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2024-09-10T07:59:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2024-09-10T07:59:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2024-09-10T07:59:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2024-09-10T07:59:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2024-09-10T07:59:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2024-09-10T07:59:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T07:59:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2024-09-10T07:59:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2024-09-10T07:59:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2024-09-10T07:59:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T07:59:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T07:59:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2024-09-10T07:59:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2024-09-10T07:59:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-10T07:59:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-10T07:59:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T07:59:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T07:59:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2024-09-10T07:59:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2024-09-10T07:59:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T07:59:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-10T07:59:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-10T07:59:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2024-09-10T07:59:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2024-09-10T07:59:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2024-09-10T07:59:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "read", 2024-09-10T07:59:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap", 2024-09-10T07:59:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap-read" 2024-09-10T07:59:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2024-09-10T07:59:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2024-09-10T07:59:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2024-09-10T07:59:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T07:59:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T07:59:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2024-09-10T07:59:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2024-09-10T07:59:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T07:59:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T07:59:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2024-09-10T07:59:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2024-09-10T07:59:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T07:59:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2024-09-10T07:59:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2024-09-10T07:59:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2024-09-10T07:59:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-10T07:59:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T07:59:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2024-09-10T07:59:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2024-09-10T07:59:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2024-09-10T07:59:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T07:59:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2024-09-10T07:59:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2024-09-10T07:59:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2024-09-10T07:59:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T07:59:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2024-09-10T07:59:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2024-09-10T07:59:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T07:59:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T07:59:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2024-09-10T07:59:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2024-09-10T07:59:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T07:59:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2024-09-10T07:59:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T07:59:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2024-09-10T07:59:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T07:59:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_log_destination": { 2024-09-10T07:59:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm_log_destination", 2024-09-10T07:59:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "file", 2024-09-10T07:59:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "file,syslog", 2024-09-10T07:59:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "syslog" 2024-09-10T07:59:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T07:59:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2024-09-10T07:59:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2024-09-10T07:59:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T07:59:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2024-09-10T07:59:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2024-09-10T07:59:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T07:59:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2024-09-10T07:59:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2024-09-10T07:59:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T07:59:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2024-09-10T07:59:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2024-09-10T07:59:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T07:59:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2024-09-10T07:59:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2024-09-10T07:59:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T07:59:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2024-09-10T07:59:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2024-09-10T07:59:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2024-09-10T07:59:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T07:59:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2024-09-10T07:59:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2024-09-10T07:59:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2024-09-10T07:59:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T07:59:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2024-09-10T07:59:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2024-09-10T07:59:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T07:59:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2024-09-10T07:59:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2024-09-10T07:59:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2024-09-10T07:59:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T07:59:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2024-09-10T07:59:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2024-09-10T07:59:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2024-09-10T07:59:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T07:59:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2024-09-10T07:59:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2024-09-10T07:59:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2024-09-10T07:59:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T07:59:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2024-09-10T07:59:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2024-09-10T07:59:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2024-09-10T07:59:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T07:59:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2024-09-10T07:59:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2024-09-10T07:59:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2024-09-10T07:59:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T07:59:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2024-09-10T07:59:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2024-09-10T07:59:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2024-09-10T07:59:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T07:59:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_nvmeof": { 2024-09-10T07:59:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_nvmeof", 2024-09-10T07:59:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T07:59:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Nvme-of container image", 2024-09-10T07:59:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2024-09-10T07:59:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2024-09-10T07:59:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T07:59:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2024-09-10T07:59:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2024-09-10T07:59:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T07:59:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2024-09-10T07:59:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_samba": { 2024-09-10T07:59:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_samba", 2024-09-10T07:59:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T07:59:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Samba/SMB container image", 2024-09-10T07:59:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2024-09-10T07:59:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2024-09-10T07:59:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T07:59:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2024-09-10T07:59:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2024-09-10T07:59:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2024-09-10T07:59:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T07:59:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2024-09-10T07:59:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2024-09-10T07:59:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T07:59:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2024-09-10T07:59:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T07:59:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2024-09-10T07:59:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T07:59:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2024-09-10T07:59:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2024-09-10T07:59:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2024-09-10T07:59:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T07:59:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2024-09-10T07:59:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2024-09-10T07:59:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2024-09-10T07:59:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2024-09-10T07:59:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2024-09-10T07:59:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2024-09-10T07:59:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T07:59:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2024-09-10T07:59:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2024-09-10T07:59:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2024-09-10T07:59:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "grafana_dashboards_path": { 2024-09-10T07:59:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "grafana_dashboards_path", 2024-09-10T07:59:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T07:59:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T07:59:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2024-09-10T07:59:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2024-09-10T07:59:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2024-09-10T07:59:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "hw_monitoring": { 2024-09-10T07:59:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hw_monitoring", 2024-09-10T07:59:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T07:59:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "inventory_list_all": { 2024-09-10T07:59:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "inventory_list_all", 2024-09-10T07:59:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T07:59:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2024-09-10T07:59:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2024-09-10T07:59:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T07:59:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T07:59:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T07:59:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T07:59:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T07:59:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T07:59:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T07:59:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2024-09-10T07:59:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T07:59:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2024-09-10T07:59:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2024-09-10T07:59:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2024-09-10T07:59:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2024-09-10T07:59:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2024-09-10T07:59:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T07:59:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2024-09-10T07:59:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2024-09-10T07:59:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2024-09-10T07:59:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-10T07:59:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-10T07:59:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2024-09-10T07:59:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2024-09-10T07:59:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2024-09-10T07:59:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T07:59:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "oob_default_addr": { 2024-09-10T07:59:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "oob_default_addr", 2024-09-10T07:59:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "169.254.1.1", 2024-09-10T07:59:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.801 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.801 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T07:59:13.801 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.801 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.801 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.801 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2024-09-10T07:59:13.801 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2024-09-10T07:59:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T07:59:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.803 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T07:59:13.803 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.803 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.803 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.803 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2024-09-10T07:59:13.803 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2024-09-10T07:59:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T07:59:13.805 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.805 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.805 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.805 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2024-09-10T07:59:13.805 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2024-09-10T07:59:13.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.805 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.806 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.806 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.806 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.806 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.806 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T07:59:13.806 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.806 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.807 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.807 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2024-09-10T07:59:13.807 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2024-09-10T07:59:13.807 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.807 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.807 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.808 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.808 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.808 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.808 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.808 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T07:59:13.808 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.808 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.809 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.809 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2024-09-10T07:59:13.809 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2024-09-10T07:59:13.809 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.809 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.809 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.810 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.810 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.810 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.810 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.810 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T07:59:13.810 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.810 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.811 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.811 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2024-09-10T07:59:13.811 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2024-09-10T07:59:13.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.811 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.811 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T07:59:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2024-09-10T07:59:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2024-09-10T07:59:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2024-09-10T07:59:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2024-09-10T07:59:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2024-09-10T07:59:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2024-09-10T07:59:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.816 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.816 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.816 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.816 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T07:59:13.816 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.816 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.816 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.817 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2024-09-10T07:59:13.817 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2024-09-10T07:59:13.817 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.817 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.817 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.817 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.817 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.817 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.818 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.818 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T07:59:13.818 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.818 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.818 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.818 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2024-09-10T07:59:13.818 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2024-09-10T07:59:13.819 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.819 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.819 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.819 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.819 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T07:59:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2024-09-10T07:59:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2024-09-10T07:59:13.821 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.821 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.821 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.821 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.821 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.821 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.822 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.822 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T07:59:13.822 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.822 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.822 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.822 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2024-09-10T07:59:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2024-09-10T07:59:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T07:59:13.824 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.824 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.824 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.824 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2024-09-10T07:59:13.824 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2024-09-10T07:59:13.824 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T07:59:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2024-09-10T07:59:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2024-09-10T07:59:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2024-09-10T07:59:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2024-09-10T07:59:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T07:59:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2024-09-10T07:59:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2024-09-10T07:59:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2024-09-10T07:59:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T07:59:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2024-09-10T07:59:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T07:59:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T07:59:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T07:59:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T07:59:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T07:59:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T07:59:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2024-09-10T07:59:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T07:59:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T07:59:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T07:59:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T07:59:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T07:59:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T07:59:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T07:59:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T07:59:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T07:59:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T07:59:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T07:59:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T07:59:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T07:59:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T07:59:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T07:59:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T07:59:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T07:59:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T07:59:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T07:59:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T07:59:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T07:59:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T07:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T07:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-10T07:59:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T07:59:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T07:59:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2024-09-10T07:59:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2024-09-10T07:59:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T07:59:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T07:59:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-10T07:59:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T07:59:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T07:59:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T07:59:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T07:59:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T07:59:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T07:59:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T07:59:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T07:59:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T07:59:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T07:59:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T07:59:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T07:59:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T07:59:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T07:59:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T07:59:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T07:59:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T07:59:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T07:59:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T07:59:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T07:59:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T07:59:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T07:59:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T07:59:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T07:59:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T07:59:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T07:59:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T07:59:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T07:59:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T07:59:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T07:59:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T07:59:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T07:59:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T07:59:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T07:59:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T07:59:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2024-09-10T07:59:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T07:59:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T07:59:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2024-09-10T07:59:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T07:59:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T07:59:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T07:59:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T07:59:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-10T07:59:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T07:59:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T07:59:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T07:59:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T07:59:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T07:59:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T07:59:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T07:59:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T07:59:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T07:59:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T07:59:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2024-09-10T07:59:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2024-09-10T07:59:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2024-09-10T07:59:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2024-09-10T07:59:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2024-09-10T07:59:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2024-09-10T07:59:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.931 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.931 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.931 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.931 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.931 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2024-09-10T07:59:13.931 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.931 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.932 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.932 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2024-09-10T07:59:13.932 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2024-09-10T07:59:13.932 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.932 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.932 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.933 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2024-09-10T07:59:13.933 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.933 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.933 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.933 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.933 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.933 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.933 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.934 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-10T07:59:13.934 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-10T07:59:13.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.934 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.935 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.935 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.935 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.935 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.935 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.935 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.936 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.936 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:13.936 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:13.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.937 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.937 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.937 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.937 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.938 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.938 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.938 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.938 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.939 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.939 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.939 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.939 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.940 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.940 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.940 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.940 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.941 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.941 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:13.941 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:13.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.942 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.942 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.942 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.943 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.943 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.943 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.943 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.944 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.944 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.944 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.945 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:13.945 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:13.945 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.945 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.945 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:13.946 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.946 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.946 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.946 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.946 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.946 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.946 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.946 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.947 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.947 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.947 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.947 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.947 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.947 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.947 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:13.947 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:13.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.948 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.948 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.948 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.948 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.948 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.948 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.948 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.949 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.949 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.949 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.949 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2024-09-10T07:59:13.949 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2024-09-10T07:59:13.949 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.950 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.950 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.950 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.950 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.950 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.950 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.950 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2024-09-10T07:59:13.950 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.951 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.951 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.951 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2024-09-10T07:59:13.951 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T07:59:13.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.951 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.952 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.952 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.952 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.952 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.952 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.952 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.952 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.952 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.953 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.953 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-10T07:59:13.953 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-10T07:59:13.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.953 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.953 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-10T07:59:13.954 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.954 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.954 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.954 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.954 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.954 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.954 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.955 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-10T07:59:13.955 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-10T07:59:13.955 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.955 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.955 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.955 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2024-09-10T07:59:13.956 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.956 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.956 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.956 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.956 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.956 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.956 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.957 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-10T07:59:13.957 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-10T07:59:13.957 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.957 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.957 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.957 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.957 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.957 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.958 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.958 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.958 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.958 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.958 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.958 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2024-09-10T07:59:13.958 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2024-09-10T07:59:13.959 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.959 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.959 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.959 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2024-09-10T07:59:13.959 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.959 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.959 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.959 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.960 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.960 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.960 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.960 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-10T07:59:13.960 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-10T07:59:13.960 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.961 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.961 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.961 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2024-09-10T07:59:13.961 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.961 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.961 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.961 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.961 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2024-09-10T07:59:13.962 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.962 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.962 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.962 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.962 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.962 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-10T07:59:13.962 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-10T07:59:13.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:13.963 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.963 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.963 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-10T07:59:13.963 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-10T07:59:13.963 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-10T07:59:13.963 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.963 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.964 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.964 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.964 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.964 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2024-09-10T07:59:13.964 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2024-09-10T07:59:13.964 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.964 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.965 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:13.965 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.965 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.965 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.965 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.965 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.965 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.966 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.966 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.966 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2024-09-10T07:59:13.967 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:13.967 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:13.967 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:13.968 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2024-09-10T07:59:13.968 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2024-09-10T07:59:13.968 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.968 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.969 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.969 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.969 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.969 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.970 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.970 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2024-09-10T07:59:13.970 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.971 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.971 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:13.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:13.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.972 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.972 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.972 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.972 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.973 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.973 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.973 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.973 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.974 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.974 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.974 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.975 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.975 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.975 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.975 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.975 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.976 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.976 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:13.976 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:13.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.977 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.977 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.977 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.977 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.977 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.977 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.977 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.977 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.978 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.978 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.978 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:13.978 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:13.978 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.978 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.978 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.978 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:13.979 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.979 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.979 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.979 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.979 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.979 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.980 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.980 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.980 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.980 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.980 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.980 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.980 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.980 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.981 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:13.981 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:13.981 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.981 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.981 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.981 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:13.981 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.982 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.982 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.982 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:13.982 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.982 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.982 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2024-09-10T07:59:13.983 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2024-09-10T07:59:13.983 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.983 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.983 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.983 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2024-09-10T07:59:13.983 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.983 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.983 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.984 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T07:59:13.984 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.984 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.984 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.984 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2024-09-10T07:59:13.984 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2024-09-10T07:59:13.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.985 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.985 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.985 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2024-09-10T07:59:13.985 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.985 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.985 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.986 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T07:59:13.986 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.986 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.986 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.987 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2024-09-10T07:59:13.987 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2024-09-10T07:59:13.987 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.987 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.987 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.987 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2024-09-10T07:59:13.987 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.988 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.988 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.988 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2024-09-10T07:59:13.988 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.988 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.988 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.988 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2024-09-10T07:59:13.989 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2024-09-10T07:59:13.989 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.989 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.989 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.989 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-10T07:59:13.989 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.989 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.990 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.990 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T07:59:13.990 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.990 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.990 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.990 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2024-09-10T07:59:13.990 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2024-09-10T07:59:13.991 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:13.991 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.991 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:13.991 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.991 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.991 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.991 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T07:59:13.992 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.992 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.992 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.992 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:13.992 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:13.992 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.992 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.993 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.993 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:13.993 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.993 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.993 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.993 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T07:59:13.993 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.994 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.994 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.994 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2024-09-10T07:59:13.994 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2024-09-10T07:59:13.994 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:13.994 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.994 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.995 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2024-09-10T07:59:13.995 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.995 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.995 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:13.995 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T07:59:13.996 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:13.996 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:13.996 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:13.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:13.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:13.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:13.997 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2024-09-10T07:59:13.997 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:13.997 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:13.997 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:13.997 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:13.998 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:13.999 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:13.999 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:13.999 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:13.999 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:13.999 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:13.999 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:13.999 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:13.999 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:13.999 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.000 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.000 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.000 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.000 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.000 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.000 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.000 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.001 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.001 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.001 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.001 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.001 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.001 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.001 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.002 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.002 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.002 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.002 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.002 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.002 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.003 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.003 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.003 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.003 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.003 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.003 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.003 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.003 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.004 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.004 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.004 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.004 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.004 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.004 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.004 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2024-09-10T07:59:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2024-09-10T07:59:14.007 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.007 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.007 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.007 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-10T07:59:14.008 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.008 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.008 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.008 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.008 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.008 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.008 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.009 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2024-09-10T07:59:14.009 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2024-09-10T07:59:14.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.009 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.009 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.009 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2024-09-10T07:59:14.009 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.010 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.010 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.010 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.010 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.010 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.010 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.010 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:14.011 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:14.011 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.011 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.011 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.011 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:14.011 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.011 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.011 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.013 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2024-09-10T07:59:14.013 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2024-09-10T07:59:14.013 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2024-09-10T07:59:14.013 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.013 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2024-09-10T07:59:14.013 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2024-09-10T07:59:14.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.014 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.014 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.014 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2024-09-10T07:59:14.014 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.014 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.014 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.014 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T07:59:14.014 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.015 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.015 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.015 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2024-09-10T07:59:14.015 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2024-09-10T07:59:14.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.015 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.015 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.016 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2024-09-10T07:59:14.016 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.016 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.016 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.016 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T07:59:14.016 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.016 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.016 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.017 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2024-09-10T07:59:14.017 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2024-09-10T07:59:14.017 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.017 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.017 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.017 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.018 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.018 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.018 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.018 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2024-09-10T07:59:14.018 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.018 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.018 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2024-09-10T07:59:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2024-09-10T07:59:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T07:59:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.026 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.026 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.026 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2024-09-10T07:59:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2024-09-10T07:59:14.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.039 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.039 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.040 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.040 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.040 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.040 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.040 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2024-09-10T07:59:14.041 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.041 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.041 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.041 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2024-09-10T07:59:14.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2024-09-10T07:59:14.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.041 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2024-09-10T07:59:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2024-09-10T07:59:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-10T07:59:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-10T07:59:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2024-09-10T07:59:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.044 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.044 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.044 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T07:59:14.044 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.044 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.044 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.044 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2024-09-10T07:59:14.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2024-09-10T07:59:14.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.045 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.045 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.045 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:14.045 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:14.045 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2024-09-10T07:59:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T07:59:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2024-09-10T07:59:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2024-09-10T07:59:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.047 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.047 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.047 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.047 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.047 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.047 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.047 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2024-09-10T07:59:14.047 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.047 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.048 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.048 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2024-09-10T07:59:14.048 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2024-09-10T07:59:14.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.048 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2024-09-10T07:59:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T07:59:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.050 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.050 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2024-09-10T07:59:14.050 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.050 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.050 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.050 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.051 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.051 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.051 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.051 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.051 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.051 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.051 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.051 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.052 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.052 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.052 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.052 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.052 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.052 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.052 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.053 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.053 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.053 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.053 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.053 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.053 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.054 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.054 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.054 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.054 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.054 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.054 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.054 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.055 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.055 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.055 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.055 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.055 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.055 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.056 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.056 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.056 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.056 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.056 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.056 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.056 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.056 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.057 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.057 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.057 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.057 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.057 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.057 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.057 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.057 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.058 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.058 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.058 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.058 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.058 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.058 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.058 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.058 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.059 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.059 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.059 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.059 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.059 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.059 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.059 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2024-09-10T07:59:14.060 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.060 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.060 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.060 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.060 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.061 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.061 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.061 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.061 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.061 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.061 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.061 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.061 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.061 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.062 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.062 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.062 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.062 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.062 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.062 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.062 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.063 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.063 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.063 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.063 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.063 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.063 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.063 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.063 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.064 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.064 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.064 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.064 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.064 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.064 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.064 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.065 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.065 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.065 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.065 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.065 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.065 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.065 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.065 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.066 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.066 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.066 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.066 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.066 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.066 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.066 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.066 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.066 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.067 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.067 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.067 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.068 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.068 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.068 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.068 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.068 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.068 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.068 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.068 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.068 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.069 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.069 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "k8sevents", 2024-09-10T07:59:14.069 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.069 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.069 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.069 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_event_retention_days": { 2024-09-10T07:59:14.070 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ceph_event_retention_days", 2024-09-10T07:59:14.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.070 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.070 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.070 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7", 2024-09-10T07:59:14.070 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.070 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.070 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.070 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T07:59:14.071 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.071 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.071 INFO:teuthology.orchestra.run.smithi073.stdout: "config_check_secs": { 2024-09-10T07:59:14.071 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_check_secs", 2024-09-10T07:59:14.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.072 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.072 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.072 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:14.072 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "10", 2024-09-10T07:59:14.072 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.072 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.073 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T07:59:14.073 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.073 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.073 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.073 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.073 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.074 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.074 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.074 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.074 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.074 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.074 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.074 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.074 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.075 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.075 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.075 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.075 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.075 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.075 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.076 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.076 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.076 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.076 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.076 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.076 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.076 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.077 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.077 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.077 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.077 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.077 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.077 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.077 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.078 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.078 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.078 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.078 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.079 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.079 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.079 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.079 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.079 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.079 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.079 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.079 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.079 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.080 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.080 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.080 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.080 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.080 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.080 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.081 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.081 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.081 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.081 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.081 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.081 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.081 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.082 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.082 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.082 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.082 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.082 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.082 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.082 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.083 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2024-09-10T07:59:14.083 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.083 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.083 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.083 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2024-09-10T07:59:14.083 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2024-09-10T07:59:14.083 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.084 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.084 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2024-09-10T07:59:14.084 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.084 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.084 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.084 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2024-09-10T07:59:14.085 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T07:59:14.085 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.085 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.085 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.085 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.086 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.086 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.086 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.086 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.086 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.086 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.087 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.088 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.088 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.088 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.088 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.088 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.089 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.089 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.089 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.089 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.089 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.089 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.090 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.090 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.090 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.090 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.090 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.090 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.090 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.090 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.091 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.091 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.091 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.091 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.091 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.091 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.091 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.092 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.092 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.092 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.092 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.092 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.092 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.092 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.093 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.093 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.093 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.093 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.093 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.093 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.093 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2024-09-10T07:59:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2024-09-10T07:59:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.096 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2024-09-10T07:59:14.096 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T07:59:14.096 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.096 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.097 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2024-09-10T07:59:14.097 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2024-09-10T07:59:14.097 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.097 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.097 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.097 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2024-09-10T07:59:14.098 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.098 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.098 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.098 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2024-09-10T07:59:14.098 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.098 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.098 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.099 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2024-09-10T07:59:14.099 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2024-09-10T07:59:14.099 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.099 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.099 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.099 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2024-09-10T07:59:14.099 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.099 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.099 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T07:59:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2024-09-10T07:59:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2024-09-10T07:59:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2024-09-10T07:59:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2024-09-10T07:59:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2024-09-10T07:59:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2024-09-10T07:59:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T07:59:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T07:59:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mds_autoscaler", 2024-09-10T07:59:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.112 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.112 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.112 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.112 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.112 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.113 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.113 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.113 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.113 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.113 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.114 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.114 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.114 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.114 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.114 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.114 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.115 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2024-09-10T07:59:14.115 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.115 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.115 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.115 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.115 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.115 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.116 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.116 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.116 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.116 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.116 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.116 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.116 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.117 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.117 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.117 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.117 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.117 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.117 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.117 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.117 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.118 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.118 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.118 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.118 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.118 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.118 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.118 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.119 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.119 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.119 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.119 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.119 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.119 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.120 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.120 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.120 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.120 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.120 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.120 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.121 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.121 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.121 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.121 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.121 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.121 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.121 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.121 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.121 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.122 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.122 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.122 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.122 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.122 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.123 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.123 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.123 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.124 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.124 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.124 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.124 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.124 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.124 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.124 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.124 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.125 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2024-09-10T07:59:14.125 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.125 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.125 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.125 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.125 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.126 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.126 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.126 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.126 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.126 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.126 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.127 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.127 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.127 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.127 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.127 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.127 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.127 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.127 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.127 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.128 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.128 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.128 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.128 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.128 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.128 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.129 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.129 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.129 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.129 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.129 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.129 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.129 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.130 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.130 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.130 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.130 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.130 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.130 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.130 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.130 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.131 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.131 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.131 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.131 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.131 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.131 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.131 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.131 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.132 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.132 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.132 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.132 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.132 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.132 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.133 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.133 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.133 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.133 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.133 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.133 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.134 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.134 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.134 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.134 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.134 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-10T07:59:14.135 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.135 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.135 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.135 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2024-09-10T07:59:14.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2024-09-10T07:59:14.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.136 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.136 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.136 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.136 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.136 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.136 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.136 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T07:59:14.136 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.137 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.137 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.137 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.137 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.137 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.138 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.138 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.138 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.138 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.138 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.138 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.138 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.138 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.139 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.140 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.140 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.140 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.140 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.140 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.140 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.140 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.141 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.141 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.141 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.141 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.141 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.141 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.142 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.142 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.142 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.142 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.142 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.142 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.143 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.143 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.143 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.143 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.143 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.143 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.144 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.144 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.144 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.144 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.144 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.144 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.145 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.145 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.145 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.145 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.145 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.145 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.145 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.146 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.146 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.146 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.146 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.146 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2024-09-10T07:59:14.146 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-10T07:59:14.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.147 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.147 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.147 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.147 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.147 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.147 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.147 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2024-09-10T07:59:14.147 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2024-09-10T07:59:14.148 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2024-09-10T07:59:14.148 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.148 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2024-09-10T07:59:14.148 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.148 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.148 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.149 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.149 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2024-09-10T07:59:14.149 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.149 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.149 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.150 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.150 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.150 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.150 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.150 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.150 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.150 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.150 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.151 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.151 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.151 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.151 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.151 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.151 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.151 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.151 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.152 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.152 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.152 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.152 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.152 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.152 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.152 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.153 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.153 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.153 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.153 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.153 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.153 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.153 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.153 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2024-09-10T07:59:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2024-09-10T07:59:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2024-09-10T07:59:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2024-09-10T07:59:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-10T07:59:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2024-09-10T07:59:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2024-09-10T07:59:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T07:59:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2024-09-10T07:59:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2024-09-10T07:59:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2024-09-10T07:59:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T07:59:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-10T07:59:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-10T07:59:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2024-09-10T07:59:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2024-09-10T07:59:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2024-09-10T07:59:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2024-09-10T07:59:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2024-09-10T07:59:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2024-09-10T07:59:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2024-09-10T07:59:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2024-09-10T07:59:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2024-09-10T07:59:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2024-09-10T07:59:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T07:59:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T07:59:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2024-09-10T07:59:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2024-09-10T07:59:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T07:59:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T07:59:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2024-09-10T07:59:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2024-09-10T07:59:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2024-09-10T07:59:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2024-09-10T07:59:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-10T07:59:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-10T07:59:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-10T07:59:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T07:59:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-10T07:59:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-10T07:59:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2024-09-10T07:59:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T07:59:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2024-09-10T07:59:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2024-09-10T07:59:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2024-09-10T07:59:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-10T07:59:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-10T07:59:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2024-09-10T07:59:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2024-09-10T07:59:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2024-09-10T07:59:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-10T07:59:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-10T07:59:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-10T07:59:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-10T07:59:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-10T07:59:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2024-09-10T07:59:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2024-09-10T07:59:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2024-09-10T07:59:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2024-09-10T07:59:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T07:59:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2024-09-10T07:59:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2024-09-10T07:59:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2024-09-10T07:59:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2024-09-10T07:59:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2024-09-10T07:59:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-10T07:59:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-10T07:59:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-10T07:59:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-10T07:59:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-10T07:59:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-10T07:59:14.282 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.282 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.282 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.282 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.282 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.282 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.282 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.282 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.283 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.283 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.283 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.283 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.283 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.284 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rgw", 2024-09-10T07:59:14.284 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.284 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.284 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.284 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.284 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.285 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.285 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.285 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.285 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.286 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.286 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.286 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.286 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.286 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.286 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.287 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.287 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.287 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.287 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.287 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.287 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.287 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.288 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.288 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.288 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.288 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.289 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.289 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.289 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.289 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.289 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.290 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.290 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.290 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.290 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.290 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.290 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.290 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.291 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.291 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.291 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.291 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.291 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.291 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.291 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.291 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.292 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.292 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.292 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.292 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.292 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.292 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.293 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.293 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.293 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.293 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.293 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.293 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.294 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.294 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.294 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.294 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.294 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.294 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.295 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.295 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.295 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.295 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.295 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.295 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.296 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rook", 2024-09-10T07:59:14.296 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.296 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.297 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.297 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.297 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.297 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.298 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.298 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.298 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.298 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.298 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.299 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.299 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.299 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.299 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.300 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.300 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.300 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.300 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.300 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.301 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.301 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.301 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.302 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.302 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.302 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.302 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.302 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.303 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.303 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.303 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.303 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.303 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.303 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.304 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.304 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.304 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.304 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.304 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.305 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.305 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.305 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.305 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.305 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.305 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.305 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.306 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.306 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.306 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.306 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.306 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.306 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.306 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.307 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.307 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.307 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.307 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.307 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.307 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.307 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.308 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.308 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.308 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.308 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.308 INFO:teuthology.orchestra.run.smithi073.stdout: "storage_class": { 2024-09-10T07:59:14.308 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "storage_class", 2024-09-10T07:59:14.309 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.309 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.309 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.309 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "local", 2024-09-10T07:59:14.309 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.309 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.309 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.309 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T07:59:14.310 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.310 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.310 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.310 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.310 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.311 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2024-09-10T07:59:14.311 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.311 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.311 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.311 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.311 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.311 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.312 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.312 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.312 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.312 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.312 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.312 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.312 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.312 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.313 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.313 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.313 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.313 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.313 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.313 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.313 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.313 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.314 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.314 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.314 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.314 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.314 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.314 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.315 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.315 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.315 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.315 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.315 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.315 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.315 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.315 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.316 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.316 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.316 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.316 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.316 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.316 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.316 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.316 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.317 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.317 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.317 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.317 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.317 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.317 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.317 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.317 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.318 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.318 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.318 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.318 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.318 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.318 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.318 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.319 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.319 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.319 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.319 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.319 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.319 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.319 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.320 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.320 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.320 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2024-09-10T07:59:14.320 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2024-09-10T07:59:14.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.320 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.320 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.321 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.321 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.321 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.321 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.321 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.321 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.322 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.322 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.322 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2024-09-10T07:59:14.322 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2024-09-10T07:59:14.322 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.322 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.322 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.323 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2024-09-10T07:59:14.323 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.323 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.323 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.323 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.323 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.323 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.323 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.324 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2024-09-10T07:59:14.324 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2024-09-10T07:59:14.324 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.324 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.324 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.324 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.325 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.325 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.325 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.325 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.325 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.325 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.325 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.326 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2024-09-10T07:59:14.326 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2024-09-10T07:59:14.326 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.326 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.326 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.326 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.326 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.327 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.327 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.327 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.327 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.327 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.327 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.327 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2024-09-10T07:59:14.328 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2024-09-10T07:59:14.328 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:14.328 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.328 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.328 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.328 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.328 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.328 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.329 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.329 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.329 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.329 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.329 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2024-09-10T07:59:14.329 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2024-09-10T07:59:14.330 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.330 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.330 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.330 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.330 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.330 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.330 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.330 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.330 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.331 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.331 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.331 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2024-09-10T07:59:14.331 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2024-09-10T07:59:14.331 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.332 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.332 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.332 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.332 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.332 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.332 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.332 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.332 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.333 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.333 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.333 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2024-09-10T07:59:14.333 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2024-09-10T07:59:14.333 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.333 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.334 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.334 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.334 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.334 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.334 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.334 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.335 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.335 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.335 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.335 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2024-09-10T07:59:14.335 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2024-09-10T07:59:14.335 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.335 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.336 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.336 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.336 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:14.336 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2024-09-10T07:59:14.336 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.336 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.336 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.336 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.337 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.337 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2024-09-10T07:59:14.337 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2024-09-10T07:59:14.337 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.337 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.337 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2024-09-10T07:59:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2024-09-10T07:59:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2024-09-10T07:59:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2024-09-10T07:59:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.342 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.342 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.342 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.342 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.343 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2024-09-10T07:59:14.343 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.343 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.343 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.343 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2024-09-10T07:59:14.343 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2024-09-10T07:59:14.343 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.343 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.344 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.344 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.344 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.344 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.344 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.344 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T07:59:14.345 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.345 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.345 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.345 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2024-09-10T07:59:14.345 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2024-09-10T07:59:14.345 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.345 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.346 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.346 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.346 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.346 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.346 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.346 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2024-09-10T07:59:14.346 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.346 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.347 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.347 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.347 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.347 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.347 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.347 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.347 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.347 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.348 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.348 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.348 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.348 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.348 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.348 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.348 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.349 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.349 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.349 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.349 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.349 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.349 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.350 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.350 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.350 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.350 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.350 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.350 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.350 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.350 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.351 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.351 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.351 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.351 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.351 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.351 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.351 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.352 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.352 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.352 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.352 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.352 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.353 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.353 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.353 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.353 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.353 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.353 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.353 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.353 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.354 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.354 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.354 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.354 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.354 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.355 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.355 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.355 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.355 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.355 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.355 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.356 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.356 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.356 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.356 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.356 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.356 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.357 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.357 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.357 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.357 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2024-09-10T07:59:14.357 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.357 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.358 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.358 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.358 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.358 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.358 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.358 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.358 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.358 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.359 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.359 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.359 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.359 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.359 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.359 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.359 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.360 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.360 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.360 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.360 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.360 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.360 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.360 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.361 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.361 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.361 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.361 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.361 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.361 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.361 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.361 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.362 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.362 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.362 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.362 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.363 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.363 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.363 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.363 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.363 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.363 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.363 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.364 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.364 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.364 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.364 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.364 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.364 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.364 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.365 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.365 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.365 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.365 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.365 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.365 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.365 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.366 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.366 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.366 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.366 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.366 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.366 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.367 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.367 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.367 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.367 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.367 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.367 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.367 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.368 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.368 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2024-09-10T07:59:14.368 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.368 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.368 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.368 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.369 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.369 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.369 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.369 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.369 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.369 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.369 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.369 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.370 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.370 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.370 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.370 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.370 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.370 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.370 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.370 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.371 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.371 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.371 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.371 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.371 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.371 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.372 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.372 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.372 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.372 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.373 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.373 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.373 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.373 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.373 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.373 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.374 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.374 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.374 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.374 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.374 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.374 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.374 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.375 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.375 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.375 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.375 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.375 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.375 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.376 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.376 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.376 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.376 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.376 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.376 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.376 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.377 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.377 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.377 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.377 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.377 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.377 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.378 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.378 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.378 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.378 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.378 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.378 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.378 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.378 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.379 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2024-09-10T07:59:14.379 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.379 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.379 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.379 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2024-09-10T07:59:14.379 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2024-09-10T07:59:14.380 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.380 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.380 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.380 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T07:59:14.380 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.380 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.380 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.380 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.381 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.381 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.381 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.381 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:14.381 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:14.381 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2024-09-10T07:59:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.383 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.383 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.383 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.384 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.384 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.384 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.384 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.384 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.384 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.384 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.384 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.385 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.385 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.385 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.385 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.385 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.385 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.386 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.386 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.386 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.386 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.386 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.387 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.387 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.387 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.387 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.387 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.387 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.387 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.388 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.388 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.388 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.388 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.388 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.389 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.389 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.389 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.389 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.389 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.389 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.389 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.391 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.391 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.391 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.391 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.391 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.391 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.392 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.392 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.392 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.392 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.392 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.393 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.393 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.393 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.393 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.393 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.393 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.394 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2024-09-10T07:59:14.394 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.395 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.395 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.395 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2024-09-10T07:59:14.395 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2024-09-10T07:59:14.395 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.395 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.395 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.396 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.396 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.396 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.396 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.396 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T07:59:14.396 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.396 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.397 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.397 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2024-09-10T07:59:14.397 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2024-09-10T07:59:14.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.397 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.397 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.398 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.398 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.398 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.398 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.398 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T07:59:14.398 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.398 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.399 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.399 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2024-09-10T07:59:14.399 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2024-09-10T07:59:14.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.399 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.399 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.400 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.400 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.400 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.400 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.400 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T07:59:14.400 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.400 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.401 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.401 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2024-09-10T07:59:14.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2024-09-10T07:59:14.401 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.401 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.401 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.401 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.402 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.402 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.402 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.402 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T07:59:14.402 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.402 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.403 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.403 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2024-09-10T07:59:14.403 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2024-09-10T07:59:14.404 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.404 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.404 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.404 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.405 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.405 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.405 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.405 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T07:59:14.406 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.406 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.406 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.406 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2024-09-10T07:59:14.406 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2024-09-10T07:59:14.406 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.406 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.407 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.407 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.407 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.407 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.407 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.407 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.407 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.407 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.408 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.408 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2024-09-10T07:59:14.408 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2024-09-10T07:59:14.408 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.408 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.409 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.409 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.409 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.409 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.409 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.409 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.409 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.410 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.410 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.410 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2024-09-10T07:59:14.410 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2024-09-10T07:59:14.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.410 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.410 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.411 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T07:59:14.411 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.411 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.411 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.411 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.411 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.411 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.411 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.412 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-10T07:59:14.412 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-10T07:59:14.412 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.412 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.412 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.412 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.412 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.413 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.413 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.413 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.413 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.413 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.413 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.413 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:14.414 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:14.414 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.414 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.414 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.414 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2024-09-10T07:59:14.414 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2024-09-10T07:59:14.414 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.414 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.415 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.415 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.415 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.415 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.415 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2024-09-10T07:59:14.415 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2024-09-10T07:59:14.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.416 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.416 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.417 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2024-09-10T07:59:14.417 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.417 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.417 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.418 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.418 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.418 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.418 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.419 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2024-09-10T07:59:14.419 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2024-09-10T07:59:14.419 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.420 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.420 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.420 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.421 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.421 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.421 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.421 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.421 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.422 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.422 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.422 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2024-09-10T07:59:14.423 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2024-09-10T07:59:14.423 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.423 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.424 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.424 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.424 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.424 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.424 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.425 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.425 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.425 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.425 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.426 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.426 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.426 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.427 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.427 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.427 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.427 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.428 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.428 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.428 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.428 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.429 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.429 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.429 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.429 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.430 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.430 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.430 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.431 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.431 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.431 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.431 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.432 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.432 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.432 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.432 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.432 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.433 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.437 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.438 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.438 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.439 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.439 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.439 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.439 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.440 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.440 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.440 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.440 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.440 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.441 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.441 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.441 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.441 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.442 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.442 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.442 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.442 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.442 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.443 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.443 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.443 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.443 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.444 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.444 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.444 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.444 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.444 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.445 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.445 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.445 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.445 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.445 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.446 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.446 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.446 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2024-09-10T07:59:14.446 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2024-09-10T07:59:14.447 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.447 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.447 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.447 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.447 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.448 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.448 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.448 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.448 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.448 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.449 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.449 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2024-09-10T07:59:14.449 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2024-09-10T07:59:14.449 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.450 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.450 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.450 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.450 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.450 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.451 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.451 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.451 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.451 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.451 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.452 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2024-09-10T07:59:14.452 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2024-09-10T07:59:14.452 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.452 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.452 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.452 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T07:59:14.452 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.453 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.453 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.453 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.453 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.453 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.453 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.453 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.454 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.454 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2024-09-10T07:59:14.454 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.454 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.455 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.455 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.455 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.455 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.455 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.456 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.456 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.456 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.456 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.456 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.456 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.456 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.456 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.457 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.457 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.457 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.457 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.457 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.457 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.458 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.458 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.458 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.458 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.458 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.458 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.458 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.459 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.459 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.459 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.459 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.459 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.459 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.459 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.459 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.460 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.460 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.460 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.460 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.460 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.461 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.461 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.461 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.461 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.461 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.461 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.461 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.462 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.462 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.462 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.462 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.462 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.462 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.462 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.462 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.463 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.463 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.463 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.463 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.463 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.463 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.463 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.463 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.464 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.464 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.464 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.464 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.464 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.464 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.465 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.465 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2024-09-10T07:59:14.465 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.465 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.466 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.466 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.466 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.466 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.466 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.466 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.467 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.467 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.467 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.468 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.468 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.468 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.468 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.468 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.468 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.468 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.468 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.469 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.469 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.469 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.469 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.469 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.469 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.469 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.470 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.470 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.470 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.470 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.470 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.470 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.470 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.470 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.471 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.471 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.471 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.471 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.471 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.471 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.472 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.472 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.472 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.472 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.472 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.472 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.472 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.472 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.473 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.473 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.473 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.473 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.473 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.473 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.473 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.474 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.474 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.474 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.474 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.474 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.474 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.474 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.475 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.475 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.475 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.475 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.475 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.475 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.476 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2024-09-10T07:59:14.476 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2024-09-10T07:59:14.476 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.476 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.476 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.476 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2024-09-10T07:59:14.476 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.476 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.477 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.477 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T07:59:14.477 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.477 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.477 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.478 INFO:teuthology.orchestra.run.smithi073.stdout: "periodic_async_work": { 2024-09-10T07:59:14.478 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "periodic_async_work", 2024-09-10T07:59:14.478 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.478 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.478 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.478 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.478 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.479 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.479 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.479 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Periodically check for async work", 2024-09-10T07:59:14.479 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.479 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.479 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.480 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2024-09-10T07:59:14.480 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2024-09-10T07:59:14.480 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.480 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.480 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.480 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:14.480 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.480 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.481 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.481 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T07:59:14.481 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.481 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.481 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.481 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_no_wait": { 2024-09-10T07:59:14.481 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T07:59:14.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.482 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.482 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.482 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.482 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.482 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.483 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.483 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T07:59:14.483 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.483 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.484 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.484 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2024-09-10T07:59:14.485 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.485 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.485 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.485 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2024-09-10T07:59:14.486 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2024-09-10T07:59:14.486 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:14.486 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.486 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.486 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2024-09-10T07:59:14.486 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.486 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.486 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.486 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.487 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.487 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.487 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.487 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2024-09-10T07:59:14.487 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2024-09-10T07:59:14.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.487 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.488 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.488 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.488 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.488 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.488 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.488 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.489 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.489 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.489 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.490 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:14.490 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:14.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.490 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.490 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.490 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:14.490 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.490 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.491 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.491 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.491 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.491 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.491 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.491 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.491 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.492 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.492 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.492 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.492 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.492 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.492 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.492 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.493 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.493 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.493 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.493 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.493 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.493 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.493 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.493 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.494 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.494 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.494 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.494 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.494 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.494 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.495 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.495 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.495 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.495 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.495 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.496 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.496 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.496 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.496 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.496 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.496 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.496 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.497 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.497 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.497 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.497 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.497 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.497 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.498 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.498 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.498 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.498 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.498 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.498 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.498 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.499 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.499 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.499 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.499 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.499 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.499 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.500 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.500 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.500 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.500 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.500 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.500 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.500 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.500 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.501 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.501 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.501 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.501 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.501 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2024-09-10T07:59:14.501 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2024-09-10T07:59:14.501 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.502 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.502 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.502 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.502 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.502 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.502 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.502 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.503 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.503 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.503 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.503 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2024-09-10T07:59:14.503 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2024-09-10T07:59:14.503 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2024-09-10T07:59:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.504 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2024-09-10T07:59:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2024-09-10T07:59:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.506 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T07:59:14.506 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.506 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.506 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.506 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.506 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.507 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.507 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.507 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:14.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.508 INFO:teuthology.orchestra.run.smithi073.stdout: "gid": 24764, 2024-09-10T07:59:14.508 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "y", 2024-09-10T07:59:14.508 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_features": 4540701547738038271, 2024-09-10T07:59:14.508 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2024-09-10T07:59:14.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.508 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2024-09-10T07:59:14.509 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.509 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.509 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.509 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:14.509 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:14.509 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.509 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.509 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.509 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:14.510 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.510 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.510 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.510 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T07:59:14.510 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.510 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.510 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.511 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.511 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.511 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.511 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.511 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.511 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.511 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.511 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.512 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.512 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.512 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.512 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.512 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.512 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.512 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.512 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.513 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.513 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.513 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.513 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.513 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.513 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.514 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.514 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.514 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.514 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.514 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.514 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.514 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.514 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.514 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.515 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.515 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.515 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.515 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.515 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.515 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.516 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.516 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.516 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.516 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.516 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.516 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.516 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.516 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.518 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.518 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.518 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.519 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.519 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.519 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.519 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.519 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.519 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.519 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.519 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.520 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.520 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.520 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2024-09-10T07:59:14.520 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2024-09-10T07:59:14.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.520 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.521 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.521 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.521 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.521 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.521 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.521 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2024-09-10T07:59:14.521 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.521 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.522 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.522 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2024-09-10T07:59:14.522 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2024-09-10T07:59:14.522 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.522 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.522 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2024-09-10T07:59:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2024-09-10T07:59:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.524 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2024-09-10T07:59:14.524 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2024-09-10T07:59:14.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.524 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.524 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.524 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.525 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.525 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.525 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.525 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2024-09-10T07:59:14.525 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.525 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.525 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.526 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2024-09-10T07:59:14.526 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2024-09-10T07:59:14.526 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.527 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.527 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.527 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.527 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.528 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.528 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.528 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2024-09-10T07:59:14.528 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.529 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.529 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.529 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2024-09-10T07:59:14.530 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2024-09-10T07:59:14.530 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.530 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.530 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.530 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2024-09-10T07:59:14.531 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.531 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.531 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.531 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2024-09-10T07:59:14.532 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.532 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.532 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.533 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2024-09-10T07:59:14.533 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2024-09-10T07:59:14.533 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.533 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.534 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.534 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.534 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.534 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.534 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.535 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2024-09-10T07:59:14.535 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.535 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.535 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.535 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2024-09-10T07:59:14.535 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2024-09-10T07:59:14.536 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.536 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.536 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.536 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.536 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.536 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.536 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.536 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T07:59:14.537 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.537 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.537 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.537 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2024-09-10T07:59:14.537 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2024-09-10T07:59:14.538 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.538 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.538 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.538 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.538 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.538 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.538 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.539 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2024-09-10T07:59:14.539 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.539 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.539 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.539 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.540 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.540 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2024-09-10T07:59:14.541 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.541 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.541 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.541 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2024-09-10T07:59:14.542 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2024-09-10T07:59:14.542 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.542 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.542 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T07:59:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.544 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2024-09-10T07:59:14.544 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2024-09-10T07:59:14.544 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.544 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.544 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.544 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2024-09-10T07:59:14.544 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.545 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.545 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.545 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T07:59:14.545 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T07:59:14.545 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.545 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.546 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2024-09-10T07:59:14.546 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2024-09-10T07:59:14.546 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:14.546 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.546 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.546 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:14.546 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-10T07:59:14.546 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-10T07:59:14.547 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.547 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T07:59:14.547 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T07:59:14.547 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.547 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.547 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2024-09-10T07:59:14.547 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2024-09-10T07:59:14.547 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:14.548 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.548 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.548 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2024-09-10T07:59:14.548 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:14.548 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2024-09-10T07:59:14.548 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.548 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T07:59:14.548 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.549 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.549 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.549 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2024-09-10T07:59:14.549 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2024-09-10T07:59:14.549 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.549 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.549 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.550 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T07:59:14.550 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.550 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.550 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.550 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T07:59:14.550 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T07:59:14.550 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.550 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.551 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2024-09-10T07:59:14.551 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2024-09-10T07:59:14.551 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:14.551 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.551 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.551 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2024-09-10T07:59:14.551 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2024-09-10T07:59:14.551 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2024-09-10T07:59:14.552 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.552 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2024-09-10T07:59:14.552 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T07:59:14.552 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.552 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.552 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2024-09-10T07:59:14.553 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2024-09-10T07:59:14.553 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.553 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.553 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.554 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2024-09-10T07:59:14.554 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.554 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.554 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.554 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T07:59:14.555 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T07:59:14.555 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.555 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.555 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2024-09-10T07:59:14.556 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2024-09-10T07:59:14.556 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:14.556 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.556 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.556 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:14.556 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-10T07:59:14.556 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-10T07:59:14.557 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.557 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T07:59:14.557 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T07:59:14.557 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.557 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.558 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.558 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.558 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.558 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.558 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.558 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.558 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.559 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.559 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.559 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.559 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.559 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.559 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.559 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.560 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.560 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.560 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.560 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.560 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.560 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.561 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.561 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.561 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.561 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.561 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.562 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.562 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.562 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.562 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.562 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.562 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.563 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.563 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.563 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.563 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.564 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.564 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.564 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.564 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.564 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.565 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.565 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.565 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.565 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.565 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.565 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.565 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.566 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.566 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.566 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.566 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.566 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.566 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.566 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.567 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.567 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.567 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.567 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.567 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.567 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.567 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.568 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.568 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.568 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.568 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2024-09-10T07:59:14.568 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2024-09-10T07:59:14.568 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:14.569 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.569 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.569 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:14.569 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.569 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.569 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.570 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T07:59:14.570 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.570 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.570 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-10T07:59:14.570 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-10T07:59:14.571 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.571 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.571 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.571 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2024-09-10T07:59:14.571 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.571 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.572 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.572 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2024-09-10T07:59:14.572 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2024-09-10T07:59:14.572 INFO:teuthology.orchestra.run.smithi073.stdout: "read", 2024-09-10T07:59:14.573 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap", 2024-09-10T07:59:14.573 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap-read" 2024-09-10T07:59:14.573 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.573 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2024-09-10T07:59:14.573 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.573 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.574 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.574 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2024-09-10T07:59:14.574 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2024-09-10T07:59:14.574 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.574 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.574 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.574 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.575 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.575 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.575 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.575 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T07:59:14.575 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.575 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.576 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.576 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:14.576 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:14.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.576 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.576 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:14.577 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.577 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.577 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.577 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T07:59:14.577 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.577 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.577 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.578 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2024-09-10T07:59:14.578 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2024-09-10T07:59:14.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.578 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.578 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.579 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:14.579 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:14.579 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.579 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.579 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T07:59:14.579 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T07:59:14.579 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2024-09-10T07:59:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2024-09-10T07:59:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T07:59:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2024-09-10T07:59:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2024-09-10T07:59:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2024-09-10T07:59:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-10T07:59:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T07:59:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2024-09-10T07:59:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2024-09-10T07:59:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2024-09-10T07:59:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T07:59:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2024-09-10T07:59:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2024-09-10T07:59:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2024-09-10T07:59:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T07:59:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2024-09-10T07:59:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2024-09-10T07:59:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T07:59:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T07:59:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2024-09-10T07:59:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2024-09-10T07:59:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T07:59:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2024-09-10T07:59:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T07:59:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.593 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.593 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2024-09-10T07:59:14.593 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.593 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.593 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.593 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T07:59:14.593 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.593 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.594 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.594 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_log_destination": { 2024-09-10T07:59:14.594 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm_log_destination", 2024-09-10T07:59:14.594 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.594 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.594 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.595 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.595 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.595 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.595 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.595 INFO:teuthology.orchestra.run.smithi073.stdout: "file", 2024-09-10T07:59:14.595 INFO:teuthology.orchestra.run.smithi073.stdout: "file,syslog", 2024-09-10T07:59:14.595 INFO:teuthology.orchestra.run.smithi073.stdout: "syslog" 2024-09-10T07:59:14.596 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.596 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T07:59:14.596 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.596 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.596 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.597 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2024-09-10T07:59:14.597 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2024-09-10T07:59:14.597 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.597 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.597 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.597 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.598 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.598 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.598 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.598 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T07:59:14.598 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.598 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.598 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.599 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2024-09-10T07:59:14.599 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2024-09-10T07:59:14.599 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.599 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.599 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.599 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.599 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.600 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.600 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.600 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T07:59:14.600 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.600 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.600 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.601 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2024-09-10T07:59:14.601 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2024-09-10T07:59:14.601 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.601 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.601 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.601 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.601 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.601 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.602 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.602 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T07:59:14.602 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.602 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.602 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.602 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2024-09-10T07:59:14.602 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2024-09-10T07:59:14.602 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.603 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.603 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.603 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T07:59:14.603 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.603 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.603 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.603 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:14.604 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.604 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.604 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.604 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2024-09-10T07:59:14.604 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2024-09-10T07:59:14.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.604 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.605 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.605 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T07:59:14.605 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.605 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.605 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.605 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2024-09-10T07:59:14.605 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.605 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.606 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.606 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2024-09-10T07:59:14.606 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2024-09-10T07:59:14.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.606 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.606 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.607 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T07:59:14.607 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.607 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.607 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.607 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2024-09-10T07:59:14.607 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.608 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.608 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.608 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2024-09-10T07:59:14.608 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2024-09-10T07:59:14.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.608 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.608 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.609 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T07:59:14.609 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.609 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.609 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.609 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:14.609 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.609 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.609 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.610 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2024-09-10T07:59:14.610 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2024-09-10T07:59:14.610 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.610 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.610 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.610 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T07:59:14.610 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.611 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.611 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.611 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2024-09-10T07:59:14.611 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.611 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.611 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.612 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2024-09-10T07:59:14.612 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2024-09-10T07:59:14.612 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.612 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.612 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.612 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T07:59:14.612 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.612 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.613 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.613 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2024-09-10T07:59:14.613 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.613 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.613 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.613 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2024-09-10T07:59:14.613 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2024-09-10T07:59:14.614 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.614 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.614 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.614 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T07:59:14.614 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.614 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.614 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.615 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2024-09-10T07:59:14.615 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.615 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.615 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.615 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2024-09-10T07:59:14.615 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2024-09-10T07:59:14.615 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.616 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.616 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.616 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T07:59:14.616 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.616 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.616 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.616 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2024-09-10T07:59:14.616 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.617 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.617 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.617 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2024-09-10T07:59:14.617 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2024-09-10T07:59:14.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.618 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.618 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.618 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T07:59:14.618 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.618 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.618 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.618 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2024-09-10T07:59:14.618 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.619 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.619 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.619 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2024-09-10T07:59:14.619 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2024-09-10T07:59:14.619 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.619 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.619 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.620 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T07:59:14.620 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.620 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.620 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.620 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2024-09-10T07:59:14.620 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.620 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.620 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.621 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2024-09-10T07:59:14.621 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2024-09-10T07:59:14.621 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.621 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.621 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.621 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T07:59:14.621 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.622 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.622 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.622 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:14.622 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.622 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.622 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.622 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_nvmeof": { 2024-09-10T07:59:14.623 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_nvmeof", 2024-09-10T07:59:14.623 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.623 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.623 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.623 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T07:59:14.623 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.623 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.623 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.624 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Nvme-of container image", 2024-09-10T07:59:14.624 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.624 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.624 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.624 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2024-09-10T07:59:14.624 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2024-09-10T07:59:14.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.625 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.625 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.625 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T07:59:14.625 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.625 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.625 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.625 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:14.625 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.626 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.626 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.626 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2024-09-10T07:59:14.626 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2024-09-10T07:59:14.626 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.626 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.626 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.627 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T07:59:14.627 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.627 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.627 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.627 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2024-09-10T07:59:14.627 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.628 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.628 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.628 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_samba": { 2024-09-10T07:59:14.628 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_samba", 2024-09-10T07:59:14.628 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.629 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.629 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.629 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T07:59:14.629 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.629 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.629 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.629 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Samba/SMB container image", 2024-09-10T07:59:14.629 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.630 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.630 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.630 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2024-09-10T07:59:14.630 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2024-09-10T07:59:14.630 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.630 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.631 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.631 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T07:59:14.631 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.631 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.631 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.631 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2024-09-10T07:59:14.631 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.631 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.632 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.632 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2024-09-10T07:59:14.632 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2024-09-10T07:59:14.632 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.632 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.632 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.632 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.633 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.633 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.633 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.633 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T07:59:14.633 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.633 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.633 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.634 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2024-09-10T07:59:14.634 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2024-09-10T07:59:14.634 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.634 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.634 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.634 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:14.634 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.634 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.635 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.635 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T07:59:14.635 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.635 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.635 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.635 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2024-09-10T07:59:14.635 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T07:59:14.636 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.636 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.636 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.636 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2024-09-10T07:59:14.636 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.636 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.636 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.637 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T07:59:14.637 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.637 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.637 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.638 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2024-09-10T07:59:14.638 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2024-09-10T07:59:14.638 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.638 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.638 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.639 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2024-09-10T07:59:14.639 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.639 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.639 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.639 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T07:59:14.640 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.640 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.640 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.640 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2024-09-10T07:59:14.641 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2024-09-10T07:59:14.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.641 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.641 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.642 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2024-09-10T07:59:14.642 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.642 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.642 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.642 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2024-09-10T07:59:14.642 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.643 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.643 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.643 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2024-09-10T07:59:14.643 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2024-09-10T07:59:14.644 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.644 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.644 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.644 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.644 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.645 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.645 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.645 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T07:59:14.645 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.645 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.646 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.646 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2024-09-10T07:59:14.646 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2024-09-10T07:59:14.646 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.647 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.647 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.647 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:14.647 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.647 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.648 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.648 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2024-09-10T07:59:14.648 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.649 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.649 INFO:teuthology.orchestra.run.smithi073.stdout: "grafana_dashboards_path": { 2024-09-10T07:59:14.649 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "grafana_dashboards_path", 2024-09-10T07:59:14.649 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.650 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.650 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.650 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T07:59:14.650 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.650 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.650 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.651 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T07:59:14.651 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.651 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.651 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.651 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2024-09-10T07:59:14.651 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2024-09-10T07:59:14.651 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.652 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.652 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.652 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:14.652 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.652 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.652 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.652 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2024-09-10T07:59:14.652 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.653 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.653 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.653 INFO:teuthology.orchestra.run.smithi073.stdout: "hw_monitoring": { 2024-09-10T07:59:14.653 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hw_monitoring", 2024-09-10T07:59:14.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.653 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.653 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.654 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.654 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.654 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.654 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T07:59:14.654 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.654 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.655 INFO:teuthology.orchestra.run.smithi073.stdout: "inventory_list_all": { 2024-09-10T07:59:14.655 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "inventory_list_all", 2024-09-10T07:59:14.655 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.655 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.655 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.656 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.656 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.656 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.656 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.656 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T07:59:14.656 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.657 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.657 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.657 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.657 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.657 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.658 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.658 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.658 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.658 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.658 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.658 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.659 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.659 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.659 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.659 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.659 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.659 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.659 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.659 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.660 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.660 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2024-09-10T07:59:14.660 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2024-09-10T07:59:14.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.660 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.660 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.660 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.661 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.661 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.661 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.661 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T07:59:14.661 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.661 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.661 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.662 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.662 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.662 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.662 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.662 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.662 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.662 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.662 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.663 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.663 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T07:59:14.663 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.663 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.663 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.663 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.663 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.664 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.664 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.664 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.664 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.664 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.664 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.665 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.665 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.665 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.665 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.665 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.665 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.665 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.666 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.666 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.666 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.666 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.666 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.666 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.667 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.667 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.667 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.667 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.667 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.667 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.667 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.667 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.667 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.668 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T07:59:14.668 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T07:59:14.668 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.668 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.668 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.668 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.669 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.669 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.669 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.669 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T07:59:14.669 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.669 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.670 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.670 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T07:59:14.670 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T07:59:14.670 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.670 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.670 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.670 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2024-09-10T07:59:14.671 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.671 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.671 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.671 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T07:59:14.671 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.671 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.671 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.672 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2024-09-10T07:59:14.672 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2024-09-10T07:59:14.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.672 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.672 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.672 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:14.672 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.672 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.672 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.673 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2024-09-10T07:59:14.673 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.673 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.673 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.673 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2024-09-10T07:59:14.674 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2024-09-10T07:59:14.674 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.674 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.674 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.674 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:14.674 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.674 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.674 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.674 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T07:59:14.675 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.675 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.675 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.675 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2024-09-10T07:59:14.675 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2024-09-10T07:59:14.675 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.676 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.676 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.676 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.676 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.676 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.676 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.676 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2024-09-10T07:59:14.676 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.677 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.677 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.677 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-10T07:59:14.677 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-10T07:59:14.677 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.677 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.678 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.678 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2024-09-10T07:59:14.678 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.678 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.678 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.678 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2024-09-10T07:59:14.678 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2024-09-10T07:59:14.678 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.679 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T07:59:14.679 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.679 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.679 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.679 INFO:teuthology.orchestra.run.smithi073.stdout: "oob_default_addr": { 2024-09-10T07:59:14.679 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "oob_default_addr", 2024-09-10T07:59:14.680 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.680 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.680 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.680 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "169.254.1.1", 2024-09-10T07:59:14.680 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.680 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.680 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.681 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T07:59:14.681 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.681 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.681 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.681 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2024-09-10T07:59:14.682 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2024-09-10T07:59:14.682 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.682 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.682 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.682 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T07:59:14.682 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.682 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.682 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.683 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T07:59:14.683 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.683 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.683 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.683 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2024-09-10T07:59:14.683 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2024-09-10T07:59:14.683 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.684 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.684 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.684 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.684 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.684 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.684 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.684 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T07:59:14.684 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.685 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.685 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.685 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2024-09-10T07:59:14.685 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2024-09-10T07:59:14.685 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.685 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.685 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.686 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.686 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.686 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.686 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.686 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T07:59:14.686 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.686 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.687 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.687 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2024-09-10T07:59:14.687 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2024-09-10T07:59:14.687 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.687 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.687 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.687 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.688 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.688 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.688 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.688 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T07:59:14.688 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.688 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.688 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.689 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2024-09-10T07:59:14.689 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2024-09-10T07:59:14.689 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.689 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.689 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.689 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.689 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.690 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.690 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.690 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T07:59:14.690 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.690 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.690 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.691 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2024-09-10T07:59:14.691 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2024-09-10T07:59:14.691 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.691 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.691 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.691 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T07:59:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.693 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2024-09-10T07:59:14.693 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2024-09-10T07:59:14.693 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.693 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.693 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.693 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2024-09-10T07:59:14.693 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.693 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2024-09-10T07:59:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2024-09-10T07:59:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2024-09-10T07:59:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T07:59:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2024-09-10T07:59:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2024-09-10T07:59:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T07:59:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2024-09-10T07:59:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2024-09-10T07:59:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T07:59:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2024-09-10T07:59:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2024-09-10T07:59:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T07:59:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2024-09-10T07:59:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2024-09-10T07:59:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T07:59:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2024-09-10T07:59:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2024-09-10T07:59:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T07:59:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2024-09-10T07:59:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2024-09-10T07:59:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2024-09-10T07:59:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2024-09-10T07:59:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T07:59:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2024-09-10T07:59:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2024-09-10T07:59:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2024-09-10T07:59:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T07:59:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2024-09-10T07:59:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T07:59:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T07:59:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T07:59:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T07:59:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T07:59:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T07:59:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2024-09-10T07:59:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T07:59:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T07:59:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T07:59:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T07:59:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T07:59:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T07:59:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T07:59:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T07:59:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T07:59:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T07:59:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T07:59:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T07:59:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T07:59:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T07:59:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T07:59:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T07:59:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T07:59:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T07:59:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T07:59:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T07:59:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T07:59:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T07:59:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T07:59:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-10T07:59:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T07:59:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T07:59:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2024-09-10T07:59:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2024-09-10T07:59:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T07:59:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T07:59:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-10T07:59:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T07:59:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T07:59:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T07:59:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T07:59:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T07:59:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T07:59:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T07:59:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T07:59:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T07:59:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T07:59:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T07:59:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T07:59:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T07:59:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T07:59:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T07:59:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T07:59:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T07:59:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T07:59:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T07:59:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T07:59:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T07:59:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T07:59:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T07:59:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T07:59:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T07:59:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T07:59:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T07:59:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T07:59:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T07:59:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T07:59:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T07:59:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T07:59:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T07:59:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T07:59:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T07:59:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2024-09-10T07:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T07:59:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T07:59:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2024-09-10T07:59:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T07:59:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T07:59:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T07:59:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T07:59:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-10T07:59:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T07:59:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T07:59:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T07:59:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T07:59:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T07:59:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T07:59:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T07:59:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T07:59:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T07:59:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T07:59:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2024-09-10T07:59:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2024-09-10T07:59:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2024-09-10T07:59:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2024-09-10T07:59:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2024-09-10T07:59:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2024-09-10T07:59:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2024-09-10T07:59:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2024-09-10T07:59:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2024-09-10T07:59:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2024-09-10T07:59:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-10T07:59:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-10T07:59:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2024-09-10T07:59:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2024-09-10T07:59:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2024-09-10T07:59:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2024-09-10T07:59:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T07:59:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-10T07:59:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-10T07:59:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-10T07:59:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-10T07:59:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-10T07:59:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2024-09-10T07:59:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-10T07:59:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-10T07:59:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2024-09-10T07:59:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.856 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-10T07:59:14.856 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-10T07:59:14.856 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.856 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.856 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.857 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2024-09-10T07:59:14.857 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.857 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.857 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.857 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.857 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2024-09-10T07:59:14.858 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.858 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.858 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.858 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.858 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.858 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-10T07:59:14.858 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-10T07:59:14.859 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.859 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.859 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.859 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-10T07:59:14.859 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-10T07:59:14.859 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-10T07:59:14.860 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.860 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.860 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.860 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.860 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.860 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2024-09-10T07:59:14.860 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2024-09-10T07:59:14.861 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.861 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.861 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.861 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.861 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.861 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.862 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.862 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.862 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.862 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.862 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.862 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.862 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.863 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2024-09-10T07:59:14.863 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.863 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.863 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.863 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2024-09-10T07:59:14.863 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2024-09-10T07:59:14.864 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.864 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.864 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.864 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.864 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.864 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.864 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.865 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2024-09-10T07:59:14.865 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.865 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.865 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.865 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.865 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.866 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.866 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.866 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.866 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.866 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.866 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.867 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.867 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.867 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.867 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.867 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.867 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.868 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.868 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.868 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.868 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.868 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.868 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.869 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.869 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.869 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.869 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.869 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.869 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.869 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.870 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.870 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.870 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.870 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.870 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.870 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.871 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.871 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.871 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.871 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.871 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.872 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.872 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.872 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.872 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.872 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.873 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.873 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.873 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.873 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.873 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.873 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.873 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.873 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.874 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.874 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.874 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.874 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.874 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.874 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.875 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.875 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.875 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.875 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.875 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.876 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.876 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.876 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.876 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.877 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2024-09-10T07:59:14.877 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2024-09-10T07:59:14.877 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.877 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.877 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.878 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2024-09-10T07:59:14.878 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.878 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.878 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.878 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T07:59:14.879 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.879 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.879 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.879 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2024-09-10T07:59:14.879 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2024-09-10T07:59:14.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.879 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.880 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.880 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2024-09-10T07:59:14.880 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.880 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.880 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.880 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T07:59:14.880 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.881 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.881 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.881 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2024-09-10T07:59:14.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2024-09-10T07:59:14.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.882 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.882 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.882 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2024-09-10T07:59:14.882 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.882 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.883 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.883 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2024-09-10T07:59:14.883 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.883 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.883 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.883 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2024-09-10T07:59:14.883 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2024-09-10T07:59:14.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.884 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.884 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.884 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-10T07:59:14.884 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.884 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.885 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.885 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T07:59:14.885 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.885 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.885 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.886 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2024-09-10T07:59:14.886 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2024-09-10T07:59:14.886 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.886 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.887 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.887 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:14.887 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.887 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.888 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.888 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T07:59:14.888 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.888 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.889 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.889 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:14.889 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:14.890 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.890 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.890 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.890 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:14.891 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.891 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.891 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.891 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T07:59:14.892 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.892 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.892 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.893 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2024-09-10T07:59:14.893 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2024-09-10T07:59:14.893 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.894 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.894 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.894 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2024-09-10T07:59:14.894 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.895 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.895 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.895 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T07:59:14.895 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.896 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.896 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.896 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.896 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.897 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2024-09-10T07:59:14.898 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.898 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.898 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.898 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.899 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.899 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.900 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.900 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.900 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.901 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.901 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.901 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.901 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.902 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.902 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.902 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.902 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.903 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.903 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.903 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.904 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.904 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.904 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.905 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.905 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.905 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.906 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.906 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.906 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.906 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.907 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.907 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.907 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.908 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.908 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.909 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.909 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.909 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.910 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.910 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.910 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.910 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.911 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.911 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.911 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.911 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.912 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.912 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.912 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.912 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.913 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.913 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.913 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.914 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.914 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.914 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.914 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.914 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.915 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.915 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.915 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.915 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.915 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2024-09-10T07:59:14.915 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2024-09-10T07:59:14.915 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.916 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.916 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-10T07:59:14.916 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.916 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.916 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.916 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.916 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2024-09-10T07:59:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2024-09-10T07:59:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2024-09-10T07:59:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2024-09-10T07:59:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2024-09-10T07:59:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2024-09-10T07:59:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2024-09-10T07:59:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2024-09-10T07:59:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2024-09-10T07:59:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T07:59:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2024-09-10T07:59:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2024-09-10T07:59:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2024-09-10T07:59:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T07:59:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2024-09-10T07:59:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2024-09-10T07:59:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2024-09-10T07:59:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2024-09-10T07:59:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2024-09-10T07:59:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T07:59:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.937 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.937 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.937 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2024-09-10T07:59:14.937 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2024-09-10T07:59:14.937 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.937 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.937 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.938 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.938 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.938 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.938 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.938 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2024-09-10T07:59:14.938 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.938 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.938 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.939 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2024-09-10T07:59:14.939 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2024-09-10T07:59:14.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.939 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.939 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.939 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2024-09-10T07:59:14.939 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.940 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.940 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.940 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2024-09-10T07:59:14.940 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.940 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.940 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.941 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-10T07:59:14.941 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-10T07:59:14.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.941 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.941 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.941 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2024-09-10T07:59:14.941 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.941 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.942 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.942 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T07:59:14.942 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.942 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.942 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2024-09-10T07:59:14.942 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2024-09-10T07:59:14.943 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.943 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.943 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.943 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:14.943 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:14.943 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2024-09-10T07:59:14.943 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.943 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T07:59:14.944 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.944 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.944 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.944 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2024-09-10T07:59:14.944 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2024-09-10T07:59:14.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.944 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.945 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.945 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.945 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.945 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.945 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2024-09-10T07:59:14.945 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.945 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.946 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.946 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2024-09-10T07:59:14.946 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2024-09-10T07:59:14.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.946 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.946 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.946 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2024-09-10T07:59:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T07:59:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.948 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2024-09-10T07:59:14.948 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.948 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.948 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.948 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.949 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.949 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.949 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.949 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.949 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.949 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.949 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.949 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.950 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.950 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.950 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.950 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.950 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.950 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.950 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.950 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.951 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.951 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.951 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.951 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.951 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.951 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.952 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.952 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.952 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.952 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.952 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.952 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.952 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.952 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.952 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.953 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.953 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.953 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.953 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.953 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.954 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.954 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.954 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.954 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.954 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.954 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.954 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.955 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.955 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.955 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.955 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.955 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.955 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.956 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.956 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.956 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.956 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.956 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.956 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.956 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.957 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.957 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.957 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.957 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.957 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.957 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.958 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2024-09-10T07:59:14.958 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.958 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.958 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.958 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.958 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.958 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.958 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.959 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.959 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.959 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.959 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.959 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.959 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.959 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.959 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.959 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.960 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.960 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.960 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.960 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.960 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.960 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.960 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.961 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.961 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.961 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.961 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.961 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.961 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.963 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.963 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.963 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.963 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.963 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.963 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.963 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.964 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.964 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.964 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.964 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.964 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.964 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.964 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.965 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.965 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.965 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.965 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.965 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.965 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.965 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.965 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.966 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.966 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.966 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.966 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.966 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.966 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.966 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.966 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.967 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "k8sevents", 2024-09-10T07:59:14.967 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.967 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.967 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.968 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_event_retention_days": { 2024-09-10T07:59:14.968 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ceph_event_retention_days", 2024-09-10T07:59:14.968 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.968 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.968 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.968 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7", 2024-09-10T07:59:14.968 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.968 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.969 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.969 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T07:59:14.969 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.969 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.969 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.969 INFO:teuthology.orchestra.run.smithi073.stdout: "config_check_secs": { 2024-09-10T07:59:14.969 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_check_secs", 2024-09-10T07:59:14.970 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.970 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.970 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:14.970 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:14.970 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "10", 2024-09-10T07:59:14.970 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.970 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.970 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T07:59:14.970 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.971 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.971 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.971 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.971 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.971 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.973 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.973 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.973 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.973 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.973 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.973 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.973 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.974 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.974 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.974 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.974 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.974 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.974 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.974 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.975 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.975 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.975 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.975 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.975 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.975 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.975 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.975 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.976 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.976 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.976 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.976 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.976 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.976 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.976 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.977 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.977 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.977 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.977 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.977 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.977 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.977 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.977 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.977 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.978 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.978 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.978 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.978 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.978 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.978 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.978 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.979 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.979 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.979 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.979 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.979 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.979 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.979 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:14.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:14.980 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2024-09-10T07:59:14.980 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:14.980 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:14.980 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:14.980 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2024-09-10T07:59:14.981 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2024-09-10T07:59:14.981 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.981 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.981 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.981 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2024-09-10T07:59:14.981 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.981 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.981 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.982 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2024-09-10T07:59:14.982 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T07:59:14.982 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.982 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.982 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:14.982 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:14.982 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.983 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.983 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.983 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.983 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.983 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.983 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.983 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.983 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.984 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.984 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.984 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.984 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.984 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.984 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.984 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.984 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.985 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.985 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:14.985 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:14.985 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.985 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.985 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.985 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.986 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.986 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.986 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.986 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.986 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.986 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.986 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.987 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:14.987 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:14.987 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.987 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.987 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.987 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:14.987 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.987 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.988 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:14.988 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:14.988 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:14.988 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:14.988 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:14.988 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:14.988 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:14.988 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:14.989 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.989 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.989 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.989 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.989 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:14.989 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:14.989 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:14.990 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.990 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.990 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:14.990 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.990 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.990 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.990 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:14.990 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.991 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.991 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.991 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2024-09-10T07:59:14.991 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2024-09-10T07:59:14.991 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.991 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.992 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.992 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.992 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.992 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.992 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2024-09-10T07:59:14.992 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T07:59:14.992 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.992 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.993 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2024-09-10T07:59:14.993 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2024-09-10T07:59:14.993 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.993 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.993 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.993 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2024-09-10T07:59:14.993 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.994 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.994 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.994 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2024-09-10T07:59:14.994 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.994 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.994 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.994 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2024-09-10T07:59:14.995 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2024-09-10T07:59:14.995 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:14.995 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.995 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.995 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2024-09-10T07:59:14.995 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.996 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.996 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.996 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T07:59:14.996 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.996 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.996 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.996 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2024-09-10T07:59:14.997 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2024-09-10T07:59:14.997 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.997 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.997 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.997 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:14.997 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.997 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.997 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.997 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2024-09-10T07:59:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2024-09-10T07:59:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2024-09-10T07:59:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2024-09-10T07:59:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T07:59:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T07:59:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mds_autoscaler", 2024-09-10T07:59:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.010 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2024-09-10T07:59:15.010 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.010 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.010 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.010 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.010 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.011 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.011 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.011 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.011 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.011 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.011 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.011 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.011 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.012 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.012 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.012 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.012 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.012 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.012 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.012 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.012 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.013 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.013 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.013 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.013 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.013 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.013 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.013 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.014 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.014 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.014 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.014 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.014 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.014 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.014 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.015 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.015 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.015 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.015 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.015 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.015 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.015 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.015 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.016 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.016 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.016 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.016 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.016 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.016 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.016 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.016 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.017 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.018 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.018 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.018 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.018 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.018 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.018 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.018 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.018 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.018 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.019 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.019 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.019 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2024-09-10T07:59:15.019 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.019 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.020 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.020 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.020 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.020 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.020 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.020 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.020 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.020 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.020 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.021 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.021 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.021 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.021 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.021 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.021 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.021 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.021 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.022 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.022 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.022 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.022 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.022 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.022 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.022 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.023 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.023 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.023 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.023 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.023 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.023 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.023 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.023 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.024 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.024 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.024 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.024 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.024 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.024 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.024 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.026 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.026 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.026 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.026 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.026 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.026 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.026 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.026 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.027 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.027 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.027 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.027 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.027 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.027 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.027 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.028 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.028 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.028 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.028 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.028 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.028 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.029 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-10T07:59:15.029 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.029 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.029 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.029 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2024-09-10T07:59:15.029 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2024-09-10T07:59:15.029 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.029 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T07:59:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.031 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.031 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.031 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.031 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.031 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.031 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.032 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.032 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.032 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.032 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.032 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.032 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.032 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.032 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.033 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.033 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.033 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.033 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.033 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.033 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.033 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.034 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.034 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.034 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.034 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.034 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.034 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.035 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.035 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.035 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.035 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.035 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.035 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.035 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.035 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.036 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.036 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.036 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.036 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.036 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.036 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.036 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.036 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.037 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.037 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.037 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.037 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.037 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.037 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.037 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.037 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.038 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.038 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.038 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.038 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.038 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.038 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.038 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.039 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.039 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.039 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.039 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.039 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.039 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.039 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2024-09-10T07:59:15.040 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-10T07:59:15.040 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.040 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.040 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.040 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.040 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.040 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.040 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.041 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2024-09-10T07:59:15.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2024-09-10T07:59:15.041 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2024-09-10T07:59:15.041 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.041 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2024-09-10T07:59:15.041 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.041 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.041 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.042 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2024-09-10T07:59:15.042 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.042 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.042 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.043 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.043 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.043 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.043 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.043 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.043 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.043 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.044 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.044 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.044 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.044 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.044 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.044 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.044 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.044 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.045 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.045 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.045 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.045 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.045 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.046 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.046 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.046 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.046 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.046 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.046 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.046 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.046 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.047 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.047 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.047 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.047 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.047 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.047 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.047 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.048 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.048 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.048 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.048 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.048 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.048 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.048 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.049 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.049 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.049 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.049 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.049 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.049 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.049 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.050 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.050 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.050 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.050 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.050 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.050 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.050 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.051 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.051 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.051 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.051 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.051 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.051 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.052 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2024-09-10T07:59:15.052 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.052 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.052 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.052 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.052 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.053 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.053 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.053 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.053 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.056 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.057 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.057 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.057 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.057 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.057 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.057 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.057 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.057 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.058 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.058 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.058 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.058 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.058 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.058 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.058 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.059 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.059 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.059 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.059 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.059 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.059 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.059 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.060 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.060 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.060 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.060 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.060 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.060 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.061 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.061 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.061 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.061 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.061 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.061 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.061 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.061 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.062 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.062 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.062 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.062 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.062 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.062 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.062 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.063 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.063 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.063 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.063 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.063 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.063 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.063 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.064 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.064 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.064 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.064 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2024-09-10T07:59:15.065 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.065 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.065 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.065 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.065 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.065 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.066 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.066 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.066 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.066 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.066 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.066 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.066 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.066 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.067 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.067 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.067 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.067 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.067 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.067 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.067 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.067 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.068 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.068 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.068 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.068 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.068 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.068 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.068 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.068 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.069 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.069 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.069 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.069 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.069 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.069 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.070 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.070 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.070 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.070 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.070 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.070 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.070 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.071 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.071 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.071 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.071 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.071 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.071 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.071 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.071 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.072 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.072 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.072 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.072 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.072 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.072 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.072 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.073 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.073 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.073 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.073 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.073 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.073 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.073 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.073 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.074 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:15.074 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:15.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.074 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.074 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.074 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:15.074 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.074 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2024-09-10T07:59:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2024-09-10T07:59:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-10T07:59:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2024-09-10T07:59:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2024-09-10T07:59:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T07:59:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2024-09-10T07:59:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2024-09-10T07:59:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2024-09-10T07:59:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T07:59:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-10T07:59:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-10T07:59:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2024-09-10T07:59:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2024-09-10T07:59:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2024-09-10T07:59:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2024-09-10T07:59:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2024-09-10T07:59:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2024-09-10T07:59:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2024-09-10T07:59:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2024-09-10T07:59:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.095 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.095 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.095 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.095 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.095 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.095 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.095 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.096 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.096 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2024-09-10T07:59:15.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2024-09-10T07:59:15.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.096 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.096 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.096 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.097 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.097 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.097 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T07:59:15.097 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T07:59:15.097 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.097 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.098 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.098 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.098 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.098 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.098 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.098 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.098 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.098 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.098 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.099 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.099 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.099 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.099 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.099 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.099 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.099 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.099 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.100 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.100 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.100 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.100 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.100 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.101 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.101 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.101 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.101 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.101 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.101 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.101 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.101 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.102 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.102 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.102 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.102 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.102 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.102 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.102 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.103 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.103 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.103 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.103 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.103 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.103 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.103 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.103 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.104 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.104 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.104 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.104 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.104 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.104 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.104 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.105 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.105 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.105 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.105 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.105 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.105 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.105 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.105 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.106 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.106 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.106 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.106 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2024-09-10T07:59:15.106 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2024-09-10T07:59:15.106 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.106 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.106 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.107 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.107 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.107 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.107 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.107 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.107 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.107 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.107 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.108 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T07:59:15.108 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T07:59:15.108 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.108 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.108 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.108 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2024-09-10T07:59:15.108 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.109 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.109 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.109 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.109 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.109 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.109 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.109 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2024-09-10T07:59:15.110 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2024-09-10T07:59:15.110 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.110 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.110 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.110 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2024-09-10T07:59:15.110 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.110 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.110 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.110 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.111 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.111 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.111 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.111 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-10T07:59:15.111 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-10T07:59:15.111 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.111 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.112 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.112 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-10T07:59:15.112 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.112 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.112 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.112 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T07:59:15.112 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.112 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.113 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.113 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-10T07:59:15.113 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-10T07:59:15.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.113 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.113 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2024-09-10T07:59:15.114 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.114 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.114 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.114 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T07:59:15.114 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.114 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.114 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2024-09-10T07:59:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2024-09-10T07:59:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2024-09-10T07:59:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.116 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.116 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.116 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.116 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.116 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-10T07:59:15.116 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-10T07:59:15.117 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.117 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.117 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2024-09-10T07:59:15.117 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.117 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.117 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.117 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2024-09-10T07:59:15.118 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2024-09-10T07:59:15.118 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.118 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.118 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.118 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.118 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.118 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-10T07:59:15.119 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-10T07:59:15.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.119 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.119 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.119 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-10T07:59:15.119 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-10T07:59:15.119 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-10T07:59:15.119 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.120 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.120 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.120 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.120 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.120 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.120 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.121 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2024-09-10T07:59:15.121 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.121 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.121 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.121 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.121 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.121 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.123 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.123 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.123 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.123 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.123 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.123 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.123 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.124 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.124 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.124 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.124 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.124 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.124 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.124 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.125 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.125 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.125 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.125 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.125 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.125 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.125 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.126 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.126 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.126 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.126 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.126 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.126 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.127 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.127 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.127 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.127 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.127 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.127 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.127 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.127 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.127 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.128 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.128 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.128 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.128 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.128 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.128 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.129 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.129 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.129 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.129 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.129 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.129 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.129 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.129 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2024-09-10T07:59:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2024-09-10T07:59:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.131 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.131 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.131 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.131 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.131 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.131 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2024-09-10T07:59:15.131 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T07:59:15.132 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.132 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.132 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.132 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.132 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.132 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.132 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.133 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.133 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.133 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.133 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.133 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2024-09-10T07:59:15.133 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2024-09-10T07:59:15.133 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.134 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.134 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.134 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.134 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.134 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.134 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.134 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.134 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.135 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2024-09-10T07:59:15.135 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.135 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.135 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.136 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2024-09-10T07:59:15.136 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2024-09-10T07:59:15.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.136 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.136 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.136 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.136 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.136 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.137 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.137 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.137 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.137 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.137 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.137 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-10T07:59:15.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-10T07:59:15.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.138 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.138 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.138 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.138 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.138 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.138 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.138 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.138 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.139 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.139 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.139 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.139 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.139 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.139 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.139 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.139 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.140 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.140 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.140 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.140 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.140 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.140 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.140 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.140 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.141 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.141 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.141 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.141 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.141 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.141 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.141 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.142 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.142 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.142 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.142 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.142 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.142 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.142 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.143 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.143 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.143 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.143 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.143 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.144 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.144 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.144 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.144 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.144 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.144 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.144 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.144 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.145 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.145 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.145 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.145 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.145 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.145 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.145 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.145 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.146 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.146 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.146 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.146 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.146 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.146 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.146 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.147 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.147 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.147 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.147 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.147 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.147 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.147 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-10T07:59:15.148 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-10T07:59:15.148 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.148 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.148 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.148 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.148 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.148 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.148 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.149 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.149 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.149 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.149 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.149 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-10T07:59:15.149 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-10T07:59:15.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.150 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.150 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.150 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.150 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.150 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.150 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.150 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.150 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.151 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.151 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.151 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.151 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.151 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rgw", 2024-09-10T07:59:15.151 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.152 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.152 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.152 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.152 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.152 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.152 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.152 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.153 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.153 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.153 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.153 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.153 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.153 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.153 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.153 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.154 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.154 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.154 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.154 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.154 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.154 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.154 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.155 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.155 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.155 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.155 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.155 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.155 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.155 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.155 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.155 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.156 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.156 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.156 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.156 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.156 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.156 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.156 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.157 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.157 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.157 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.157 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.157 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.157 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.157 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.157 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.157 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.158 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.158 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.158 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.158 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.158 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.158 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.158 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.159 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.159 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.159 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.159 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.159 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.159 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.159 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.159 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.160 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.160 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.160 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.160 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.160 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.160 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.160 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.161 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rook", 2024-09-10T07:59:15.161 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.161 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.161 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.161 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.161 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.161 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.162 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.162 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.162 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.162 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.162 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.162 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.162 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.162 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.163 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.163 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.163 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.163 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.163 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.163 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.163 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.163 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.164 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.164 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.164 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.164 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.164 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.165 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.165 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.165 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.165 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.165 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.165 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.165 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.166 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.166 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.166 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.166 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.166 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.166 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.166 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.166 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.167 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.167 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.167 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.167 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.167 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.167 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.167 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.167 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.169 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.169 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.169 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.169 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.169 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.169 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.169 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.169 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.170 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.170 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.170 INFO:teuthology.orchestra.run.smithi073.stdout: "storage_class": { 2024-09-10T07:59:15.170 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "storage_class", 2024-09-10T07:59:15.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.170 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.170 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "local", 2024-09-10T07:59:15.171 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.171 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.171 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.171 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T07:59:15.171 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.171 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.171 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.172 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.172 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.172 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2024-09-10T07:59:15.172 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.172 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.172 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.173 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.173 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.173 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.173 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.173 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.173 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.173 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.173 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.174 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.174 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.174 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.174 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.174 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.174 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.174 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.174 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.175 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.175 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.175 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.175 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.175 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.175 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.175 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.176 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.176 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.176 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.176 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.176 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.176 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.176 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.176 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.177 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.177 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.177 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.177 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.177 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.177 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.177 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.178 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.178 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.178 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.178 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.178 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.178 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.178 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.178 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.179 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.179 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.179 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.179 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.179 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.179 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.179 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.180 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.180 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.180 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.180 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.180 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.180 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.180 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.180 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.180 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2024-09-10T07:59:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2024-09-10T07:59:15.181 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.182 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.182 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.182 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.182 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.182 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.182 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.182 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.182 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.183 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.183 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.183 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2024-09-10T07:59:15.183 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2024-09-10T07:59:15.183 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.183 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.183 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.184 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2024-09-10T07:59:15.184 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.184 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.184 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.184 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.184 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.184 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.184 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2024-09-10T07:59:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2024-09-10T07:59:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.186 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.186 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.186 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.186 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.186 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.186 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2024-09-10T07:59:15.186 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2024-09-10T07:59:15.187 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.187 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.187 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.187 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.187 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.187 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.187 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.187 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.188 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.188 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.188 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2024-09-10T07:59:15.188 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2024-09-10T07:59:15.188 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.189 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.189 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.189 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.189 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.189 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.189 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.189 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.190 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.190 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2024-09-10T07:59:15.190 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2024-09-10T07:59:15.190 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.190 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.190 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.191 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.191 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.191 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.191 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.191 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.191 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.191 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.191 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2024-09-10T07:59:15.192 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2024-09-10T07:59:15.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.192 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.192 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.192 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.192 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.193 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.193 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.193 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.193 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.193 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.193 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2024-09-10T07:59:15.193 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2024-09-10T07:59:15.194 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.194 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.194 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.194 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.194 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.194 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.194 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.194 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.195 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.195 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.195 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2024-09-10T07:59:15.195 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2024-09-10T07:59:15.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.195 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2024-09-10T07:59:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.197 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.197 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2024-09-10T07:59:15.197 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2024-09-10T07:59:15.197 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.197 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.197 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.197 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.198 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.198 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.198 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.198 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.198 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.198 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.198 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.198 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2024-09-10T07:59:15.199 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2024-09-10T07:59:15.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.199 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.199 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.199 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.199 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.199 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.199 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.200 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.200 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.200 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.200 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.200 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2024-09-10T07:59:15.200 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2024-09-10T07:59:15.200 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.201 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.201 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.201 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.201 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.201 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.201 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.201 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.201 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.202 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.202 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.202 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.202 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.202 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2024-09-10T07:59:15.202 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.202 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.203 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.203 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2024-09-10T07:59:15.203 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2024-09-10T07:59:15.203 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.203 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.203 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.203 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.203 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.204 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.204 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.204 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T07:59:15.204 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.204 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.204 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.204 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2024-09-10T07:59:15.205 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2024-09-10T07:59:15.205 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.205 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.205 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.205 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.205 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.205 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.205 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.206 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2024-09-10T07:59:15.206 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.206 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.206 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.206 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.206 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.206 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.207 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.207 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.207 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.207 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.207 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.207 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.207 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.207 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.208 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.208 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.208 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.208 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.208 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.208 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.208 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.208 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.209 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.209 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.209 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.209 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.209 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.209 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.209 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.209 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.210 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.210 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.210 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.210 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.210 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.210 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.210 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.211 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.211 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.211 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.211 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.211 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.211 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.211 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.211 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.212 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.212 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.212 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.212 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.212 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.212 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.212 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.212 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.214 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.214 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.214 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.214 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.214 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.214 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.214 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.215 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2024-09-10T07:59:15.215 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.215 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.215 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.216 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.216 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.216 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.216 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.216 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.216 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.216 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.217 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.217 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.217 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.217 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.217 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.217 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.217 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.217 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.218 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.218 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.218 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.218 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.218 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.218 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.219 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.219 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.219 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.219 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.219 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.219 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.219 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.219 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.220 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.220 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.220 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.220 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.220 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.220 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.220 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.221 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.221 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.221 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.221 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.221 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.221 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.221 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.221 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.222 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.222 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.222 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.222 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.222 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.222 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.222 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.222 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.223 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.223 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.223 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.223 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.223 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.223 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.223 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.224 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.224 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.224 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.224 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.224 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.224 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.224 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.224 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.225 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2024-09-10T07:59:15.225 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.225 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.225 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.225 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.225 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.225 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.226 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.226 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.226 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.226 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.226 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.226 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.226 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.226 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.227 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.227 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.227 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.227 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.227 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.227 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.227 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.227 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.228 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.228 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.228 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.228 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.228 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.228 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.228 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2024-09-10T07:59:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2024-09-10T07:59:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2024-09-10T07:59:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T07:59:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2024-09-10T07:59:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2024-09-10T07:59:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2024-09-10T07:59:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2024-09-10T07:59:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T07:59:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2024-09-10T07:59:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2024-09-10T07:59:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T07:59:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2024-09-10T07:59:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2024-09-10T07:59:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T07:59:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2024-09-10T07:59:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2024-09-10T07:59:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T07:59:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2024-09-10T07:59:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2024-09-10T07:59:15.255 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.255 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.255 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.255 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.255 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.255 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.255 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.255 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T07:59:15.256 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.256 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.256 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.256 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2024-09-10T07:59:15.256 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2024-09-10T07:59:15.256 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.256 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.257 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.257 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.257 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.257 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.257 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.257 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.257 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.257 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.258 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.258 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2024-09-10T07:59:15.258 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2024-09-10T07:59:15.258 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.258 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.258 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.258 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.259 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.259 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.259 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.259 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.259 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.259 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.259 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.259 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2024-09-10T07:59:15.260 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2024-09-10T07:59:15.260 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.260 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.260 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.260 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T07:59:15.260 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.260 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.260 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.261 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.261 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.261 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.261 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.261 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-10T07:59:15.261 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-10T07:59:15.264 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.264 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.265 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.265 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.265 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.265 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.265 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.266 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.266 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.266 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.266 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:15.266 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:15.266 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.266 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2024-09-10T07:59:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2024-09-10T07:59:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.268 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.268 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2024-09-10T07:59:15.268 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2024-09-10T07:59:15.268 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.268 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.268 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.268 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2024-09-10T07:59:15.269 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.269 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.269 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.269 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.269 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.269 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.269 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.270 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2024-09-10T07:59:15.270 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2024-09-10T07:59:15.270 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.270 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.270 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.270 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.270 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.270 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.270 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.271 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.271 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.271 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.271 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.271 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2024-09-10T07:59:15.271 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2024-09-10T07:59:15.271 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.271 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2024-09-10T07:59:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2024-09-10T07:59:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2024-09-10T07:59:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2024-09-10T07:59:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.284 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.284 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.284 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.284 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.284 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.284 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.284 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.284 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.285 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2024-09-10T07:59:15.285 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2024-09-10T07:59:15.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.285 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.285 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.285 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T07:59:15.285 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.286 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.286 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.286 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.286 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.286 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.286 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.286 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.286 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.287 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2024-09-10T07:59:15.287 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.287 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.287 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.287 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.288 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.288 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.288 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.288 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.288 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.288 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.288 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.288 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.288 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.289 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.289 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.289 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.289 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.289 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.289 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.289 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.289 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.290 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.290 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.290 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.290 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.290 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.290 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.290 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.291 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.291 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.291 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.291 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.291 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.291 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.291 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.291 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.292 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.292 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.292 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.292 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.292 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.292 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.292 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.293 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.293 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.293 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.293 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.293 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.293 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.293 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.293 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.295 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.295 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.295 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.295 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.295 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.295 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.295 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.295 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.296 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.296 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.296 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.296 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2024-09-10T07:59:15.297 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.297 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.297 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.297 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.297 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.297 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.298 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.298 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.298 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.298 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.298 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.298 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.298 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.299 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.299 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.299 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.299 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.299 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.299 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.299 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.299 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.300 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.300 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.300 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.300 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.300 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.300 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.300 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.300 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.301 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.301 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.301 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.301 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.301 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.301 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.301 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.302 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.302 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.302 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.302 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.302 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.302 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.302 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.303 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.303 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.303 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.303 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.303 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.303 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.303 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.303 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.304 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.304 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.304 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.304 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.304 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.304 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.304 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.305 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.305 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.305 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.305 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.305 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.305 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2024-09-10T07:59:15.305 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2024-09-10T07:59:15.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.306 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.306 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.306 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2024-09-10T07:59:15.306 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.306 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.306 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.306 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T07:59:15.307 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.307 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.307 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.307 INFO:teuthology.orchestra.run.smithi073.stdout: "periodic_async_work": { 2024-09-10T07:59:15.307 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "periodic_async_work", 2024-09-10T07:59:15.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.307 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.307 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.308 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.308 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.308 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.308 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.308 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Periodically check for async work", 2024-09-10T07:59:15.308 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.308 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.309 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.309 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2024-09-10T07:59:15.309 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2024-09-10T07:59:15.309 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.309 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.309 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.309 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:15.310 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.310 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.310 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.310 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T07:59:15.310 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.310 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.310 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.311 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_no_wait": { 2024-09-10T07:59:15.311 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T07:59:15.311 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.311 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.311 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.311 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.311 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.311 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.311 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.312 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T07:59:15.312 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.312 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.312 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.312 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.312 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.313 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2024-09-10T07:59:15.313 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.313 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.313 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.313 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2024-09-10T07:59:15.313 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2024-09-10T07:59:15.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:15.313 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.314 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.314 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2024-09-10T07:59:15.314 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.314 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.314 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.314 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.314 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.314 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.315 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.315 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2024-09-10T07:59:15.315 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2024-09-10T07:59:15.315 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.315 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.315 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.315 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.316 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.316 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.316 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.316 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.316 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.316 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.316 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.317 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:15.317 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:15.317 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.317 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.317 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.317 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:15.317 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.317 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.318 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.318 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.318 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.318 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.318 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.318 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.318 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.319 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.319 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.319 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.319 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.319 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.319 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.319 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.319 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.320 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.320 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.320 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.320 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.320 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.320 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.320 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.320 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.321 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.321 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.321 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.321 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.321 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.321 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.321 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.321 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.322 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.322 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.322 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.322 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.322 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.322 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.322 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.323 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.323 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.323 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.323 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.323 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.323 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.323 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.323 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.324 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.324 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.324 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.324 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.324 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.324 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.324 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.324 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.325 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.325 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.325 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.325 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.325 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.325 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.325 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.326 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.326 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.326 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.326 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.326 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.326 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.326 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.326 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.327 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.327 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.327 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2024-09-10T07:59:15.327 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2024-09-10T07:59:15.327 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.327 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.327 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.327 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.328 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.328 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.328 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.328 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.328 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.328 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.328 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.329 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2024-09-10T07:59:15.329 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2024-09-10T07:59:15.329 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.329 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.329 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.329 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2024-09-10T07:59:15.329 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.329 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.330 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.330 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.330 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.330 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.330 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.330 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2024-09-10T07:59:15.330 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2024-09-10T07:59:15.330 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.331 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.331 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.331 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T07:59:15.331 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.331 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.331 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.331 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.331 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.331 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.332 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.332 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.332 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.332 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.332 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:15.332 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.332 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.332 INFO:teuthology.orchestra.run.smithi073.stdout: "modules": [ 2024-09-10T07:59:15.333 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2024-09-10T07:59:15.333 INFO:teuthology.orchestra.run.smithi073.stdout: "dashboard", 2024-09-10T07:59:15.333 INFO:teuthology.orchestra.run.smithi073.stdout: "iostat", 2024-09-10T07:59:15.333 INFO:teuthology.orchestra.run.smithi073.stdout: "nfs", 2024-09-10T07:59:15.333 INFO:teuthology.orchestra.run.smithi073.stdout: "restful", 2024-09-10T07:59:15.333 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_schedule" 2024-09-10T07:59:15.333 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.333 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2024-09-10T07:59:15.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.334 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2024-09-10T07:59:15.334 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.334 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.334 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.334 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:15.334 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:15.334 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.335 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.335 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.335 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:15.335 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.335 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.335 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.335 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T07:59:15.335 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.336 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.336 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.336 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.336 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.336 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.336 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.336 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.337 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.337 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.337 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.337 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.337 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.337 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.337 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.337 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.338 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.338 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.338 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.338 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.338 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.338 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.338 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.339 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.339 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.339 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.339 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.339 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.339 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.339 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.342 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.342 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.342 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.342 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.342 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.342 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.342 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.342 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.343 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.343 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.343 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.343 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.343 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.343 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.343 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.343 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.344 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.344 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.344 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.344 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.344 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.344 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.344 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.345 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.345 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2024-09-10T07:59:15.345 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2024-09-10T07:59:15.345 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.345 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.345 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.345 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.346 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.346 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.346 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.346 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2024-09-10T07:59:15.346 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.346 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.346 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.346 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2024-09-10T07:59:15.347 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2024-09-10T07:59:15.347 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.347 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.347 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.347 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2024-09-10T07:59:15.347 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.347 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.347 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.348 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2024-09-10T07:59:15.348 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.348 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.348 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.348 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2024-09-10T07:59:15.348 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2024-09-10T07:59:15.348 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.348 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.349 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.349 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.349 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.349 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.349 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.349 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2024-09-10T07:59:15.349 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.349 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.350 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.350 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2024-09-10T07:59:15.350 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2024-09-10T07:59:15.350 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.350 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.350 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.350 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.351 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.351 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.351 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.351 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2024-09-10T07:59:15.351 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.351 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.351 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.352 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2024-09-10T07:59:15.352 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2024-09-10T07:59:15.352 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.352 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.352 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.352 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2024-09-10T07:59:15.352 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.352 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.353 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.353 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2024-09-10T07:59:15.353 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.353 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.353 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.353 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2024-09-10T07:59:15.353 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2024-09-10T07:59:15.353 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.354 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.354 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.354 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.354 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.354 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.354 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.354 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2024-09-10T07:59:15.354 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.354 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.355 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.355 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2024-09-10T07:59:15.355 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2024-09-10T07:59:15.355 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.355 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.355 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.355 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.356 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.356 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.356 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.356 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T07:59:15.356 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.356 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.356 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.357 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2024-09-10T07:59:15.357 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2024-09-10T07:59:15.357 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.357 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.357 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.357 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.357 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.357 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.358 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.358 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2024-09-10T07:59:15.358 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.358 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.358 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.358 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.358 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.359 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2024-09-10T07:59:15.359 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.359 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.359 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.359 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2024-09-10T07:59:15.359 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2024-09-10T07:59:15.359 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.360 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.360 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.360 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.360 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.360 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.360 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.360 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T07:59:15.360 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.360 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.361 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.361 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2024-09-10T07:59:15.361 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2024-09-10T07:59:15.361 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.361 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.361 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.362 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2024-09-10T07:59:15.362 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.362 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.362 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.362 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T07:59:15.362 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T07:59:15.362 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.362 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.363 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2024-09-10T07:59:15.363 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2024-09-10T07:59:15.363 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:15.363 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.363 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.363 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:15.364 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-10T07:59:15.364 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-10T07:59:15.364 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.364 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T07:59:15.364 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T07:59:15.364 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.364 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.364 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2024-09-10T07:59:15.365 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2024-09-10T07:59:15.365 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:15.365 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.365 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.365 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2024-09-10T07:59:15.365 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:15.365 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2024-09-10T07:59:15.366 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.366 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T07:59:15.366 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.366 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.366 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.366 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2024-09-10T07:59:15.366 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2024-09-10T07:59:15.367 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.367 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.367 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.367 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T07:59:15.367 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.367 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.367 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.367 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T07:59:15.368 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T07:59:15.368 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.368 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.368 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2024-09-10T07:59:15.368 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2024-09-10T07:59:15.368 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.369 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.369 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.369 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2024-09-10T07:59:15.369 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2024-09-10T07:59:15.369 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2024-09-10T07:59:15.369 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.369 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2024-09-10T07:59:15.369 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T07:59:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2024-09-10T07:59:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2024-09-10T07:59:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2024-09-10T07:59:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T07:59:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T07:59:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2024-09-10T07:59:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2024-09-10T07:59:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2024-09-10T07:59:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2024-09-10T07:59:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T07:59:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T07:59:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.376 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.376 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.376 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.376 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.376 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.376 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.376 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.377 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.377 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.377 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.377 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.377 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.377 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.377 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.377 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.379 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.379 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.379 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.379 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.379 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.379 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.379 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.379 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.380 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.381 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.382 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.382 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.382 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2024-09-10T07:59:15.382 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2024-09-10T07:59:15.382 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.382 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.382 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T07:59:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-10T07:59:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-10T07:59:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2024-09-10T07:59:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2024-09-10T07:59:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2024-09-10T07:59:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "read", 2024-09-10T07:59:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap", 2024-09-10T07:59:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap-read" 2024-09-10T07:59:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2024-09-10T07:59:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2024-09-10T07:59:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2024-09-10T07:59:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T07:59:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T07:59:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2024-09-10T07:59:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2024-09-10T07:59:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T07:59:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T07:59:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2024-09-10T07:59:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2024-09-10T07:59:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T07:59:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2024-09-10T07:59:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2024-09-10T07:59:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2024-09-10T07:59:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-10T07:59:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T07:59:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2024-09-10T07:59:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2024-09-10T07:59:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2024-09-10T07:59:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T07:59:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2024-09-10T07:59:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2024-09-10T07:59:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2024-09-10T07:59:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T07:59:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2024-09-10T07:59:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2024-09-10T07:59:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T07:59:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T07:59:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2024-09-10T07:59:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2024-09-10T07:59:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T07:59:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2024-09-10T07:59:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T07:59:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2024-09-10T07:59:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T07:59:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.405 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_log_destination": { 2024-09-10T07:59:15.405 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm_log_destination", 2024-09-10T07:59:15.405 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.405 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.405 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.405 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.405 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.405 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.406 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.406 INFO:teuthology.orchestra.run.smithi073.stdout: "file", 2024-09-10T07:59:15.406 INFO:teuthology.orchestra.run.smithi073.stdout: "file,syslog", 2024-09-10T07:59:15.406 INFO:teuthology.orchestra.run.smithi073.stdout: "syslog" 2024-09-10T07:59:15.406 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.406 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T07:59:15.406 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.406 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.407 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.407 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2024-09-10T07:59:15.407 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2024-09-10T07:59:15.407 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.407 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.407 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.407 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.407 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.408 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.408 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.408 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T07:59:15.408 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.408 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.408 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.408 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2024-09-10T07:59:15.409 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2024-09-10T07:59:15.409 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.409 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.409 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.409 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.409 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.409 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.410 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.410 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T07:59:15.410 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.410 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.410 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.410 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2024-09-10T07:59:15.410 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2024-09-10T07:59:15.411 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.411 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.411 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.411 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.411 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.411 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.411 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.411 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T07:59:15.412 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.412 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.412 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.412 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2024-09-10T07:59:15.412 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2024-09-10T07:59:15.412 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.413 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.413 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.413 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T07:59:15.413 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.413 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.413 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.413 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:15.413 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.414 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.414 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.414 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2024-09-10T07:59:15.414 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2024-09-10T07:59:15.414 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.415 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.415 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.415 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T07:59:15.415 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.415 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.415 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.416 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2024-09-10T07:59:15.416 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.416 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.416 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.417 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2024-09-10T07:59:15.417 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2024-09-10T07:59:15.417 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.417 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.417 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.417 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T07:59:15.417 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.418 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.418 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.418 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2024-09-10T07:59:15.418 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.418 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.418 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.418 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2024-09-10T07:59:15.418 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2024-09-10T07:59:15.419 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.419 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.419 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.419 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T07:59:15.419 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.419 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.419 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.420 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:15.420 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.420 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.420 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.420 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2024-09-10T07:59:15.420 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2024-09-10T07:59:15.420 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.421 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.421 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.421 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T07:59:15.421 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.421 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.421 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.421 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2024-09-10T07:59:15.422 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.422 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.422 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.422 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2024-09-10T07:59:15.422 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2024-09-10T07:59:15.422 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.422 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.423 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.423 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T07:59:15.423 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.423 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.423 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.423 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2024-09-10T07:59:15.423 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.423 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.424 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.424 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2024-09-10T07:59:15.424 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2024-09-10T07:59:15.424 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.424 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.424 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.425 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T07:59:15.425 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.425 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.425 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.425 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2024-09-10T07:59:15.425 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.425 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.425 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.426 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2024-09-10T07:59:15.426 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2024-09-10T07:59:15.426 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.426 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.426 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.426 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T07:59:15.426 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.427 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.427 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.427 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2024-09-10T07:59:15.427 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.427 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.427 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.427 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2024-09-10T07:59:15.427 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2024-09-10T07:59:15.428 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.428 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.428 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.428 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T07:59:15.428 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.428 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.428 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.428 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2024-09-10T07:59:15.429 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.429 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.429 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.429 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2024-09-10T07:59:15.429 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2024-09-10T07:59:15.429 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.429 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.430 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.430 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T07:59:15.430 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.430 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.430 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.430 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2024-09-10T07:59:15.430 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.430 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.430 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.431 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2024-09-10T07:59:15.431 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2024-09-10T07:59:15.431 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.431 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.431 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.431 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T07:59:15.431 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.432 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.432 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.432 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:15.432 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.432 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.432 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.432 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_nvmeof": { 2024-09-10T07:59:15.433 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_nvmeof", 2024-09-10T07:59:15.433 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.433 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.433 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.433 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T07:59:15.433 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.433 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.433 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.433 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Nvme-of container image", 2024-09-10T07:59:15.434 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.434 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.434 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.434 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2024-09-10T07:59:15.434 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2024-09-10T07:59:15.434 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.435 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.435 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.435 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T07:59:15.435 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.435 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.435 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.435 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2024-09-10T07:59:15.435 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.435 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.436 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.436 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2024-09-10T07:59:15.436 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2024-09-10T07:59:15.436 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.436 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.436 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.436 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T07:59:15.437 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.437 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.437 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.437 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2024-09-10T07:59:15.437 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.437 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.437 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.438 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_samba": { 2024-09-10T07:59:15.438 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_samba", 2024-09-10T07:59:15.438 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.438 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.438 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.438 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T07:59:15.438 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.438 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.439 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.439 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Samba/SMB container image", 2024-09-10T07:59:15.439 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.439 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.439 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.439 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2024-09-10T07:59:15.439 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2024-09-10T07:59:15.440 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.440 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.440 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.440 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T07:59:15.440 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.440 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.440 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.440 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2024-09-10T07:59:15.441 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.441 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.441 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.441 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2024-09-10T07:59:15.441 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2024-09-10T07:59:15.441 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.442 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.442 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.442 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.442 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.442 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.442 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.442 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T07:59:15.442 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.443 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.443 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.443 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2024-09-10T07:59:15.443 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2024-09-10T07:59:15.443 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.443 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.443 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.444 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:15.444 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.444 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.444 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.444 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T07:59:15.444 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.444 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.444 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.445 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2024-09-10T07:59:15.445 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T07:59:15.445 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.445 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.445 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.445 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2024-09-10T07:59:15.445 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.445 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.446 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.446 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T07:59:15.446 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.446 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.446 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.446 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2024-09-10T07:59:15.446 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2024-09-10T07:59:15.447 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.447 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.447 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.447 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2024-09-10T07:59:15.447 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.447 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.447 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.447 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T07:59:15.448 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.448 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.448 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.448 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2024-09-10T07:59:15.448 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2024-09-10T07:59:15.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.448 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.449 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.449 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2024-09-10T07:59:15.449 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.449 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.449 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.449 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2024-09-10T07:59:15.449 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.449 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.450 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.450 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2024-09-10T07:59:15.450 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2024-09-10T07:59:15.450 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.450 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.450 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.450 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.450 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.451 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.451 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.451 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T07:59:15.451 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.451 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.451 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.451 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2024-09-10T07:59:15.452 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2024-09-10T07:59:15.452 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.452 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.452 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.452 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:15.452 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.452 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.452 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.453 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2024-09-10T07:59:15.453 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.453 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.453 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.453 INFO:teuthology.orchestra.run.smithi073.stdout: "grafana_dashboards_path": { 2024-09-10T07:59:15.453 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "grafana_dashboards_path", 2024-09-10T07:59:15.453 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.454 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.454 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.454 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T07:59:15.454 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.454 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.455 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.455 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T07:59:15.455 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.455 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.455 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.455 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2024-09-10T07:59:15.455 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2024-09-10T07:59:15.456 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.456 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.456 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.456 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:15.456 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.456 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.456 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.456 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2024-09-10T07:59:15.457 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.457 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.457 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.457 INFO:teuthology.orchestra.run.smithi073.stdout: "hw_monitoring": { 2024-09-10T07:59:15.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hw_monitoring", 2024-09-10T07:59:15.457 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.457 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.458 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.458 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.458 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.458 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.458 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.458 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T07:59:15.458 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.458 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.458 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.459 INFO:teuthology.orchestra.run.smithi073.stdout: "inventory_list_all": { 2024-09-10T07:59:15.459 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "inventory_list_all", 2024-09-10T07:59:15.459 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.459 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.459 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.459 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.459 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.460 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.460 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.460 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T07:59:15.460 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.460 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.460 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.460 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.461 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.461 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.461 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.461 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.461 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.461 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.461 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.462 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.462 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.462 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.462 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.462 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.462 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.462 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.462 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.462 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.463 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.463 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.463 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2024-09-10T07:59:15.463 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2024-09-10T07:59:15.463 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.463 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.463 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.464 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.464 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.464 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.464 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.464 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T07:59:15.464 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.464 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.464 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.465 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.465 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.465 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.465 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.465 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.465 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.465 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.465 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.466 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.466 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T07:59:15.466 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.466 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.466 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.466 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.466 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.467 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.467 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.467 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.467 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.467 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.467 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.467 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.467 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.468 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.468 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.468 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.468 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.468 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.468 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.468 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.468 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.469 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.469 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.469 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.469 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.469 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.469 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.469 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.470 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.470 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.470 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.470 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.470 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.470 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.470 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.470 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.471 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T07:59:15.471 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T07:59:15.471 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.471 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.471 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.471 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.471 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.471 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.472 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.472 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T07:59:15.472 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.472 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.472 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.472 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T07:59:15.472 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T07:59:15.473 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.473 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.473 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.473 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2024-09-10T07:59:15.473 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.473 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.473 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.473 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T07:59:15.474 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.474 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.474 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.474 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2024-09-10T07:59:15.474 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2024-09-10T07:59:15.474 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.474 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.474 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.475 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:15.475 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.475 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.475 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.475 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2024-09-10T07:59:15.475 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.475 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.475 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2024-09-10T07:59:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2024-09-10T07:59:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T07:59:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2024-09-10T07:59:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2024-09-10T07:59:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2024-09-10T07:59:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2024-09-10T07:59:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2024-09-10T07:59:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2024-09-10T07:59:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2024-09-10T07:59:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2024-09-10T07:59:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T07:59:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "oob_default_addr": { 2024-09-10T07:59:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "oob_default_addr", 2024-09-10T07:59:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "169.254.1.1", 2024-09-10T07:59:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T07:59:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2024-09-10T07:59:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2024-09-10T07:59:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T07:59:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T07:59:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2024-09-10T07:59:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2024-09-10T07:59:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T07:59:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2024-09-10T07:59:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2024-09-10T07:59:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T07:59:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2024-09-10T07:59:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2024-09-10T07:59:15.489 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.489 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.489 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.489 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.489 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.489 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.489 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.489 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T07:59:15.490 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.490 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.490 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.490 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2024-09-10T07:59:15.490 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2024-09-10T07:59:15.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.490 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.491 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.491 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.491 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.491 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.491 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.491 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T07:59:15.491 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.491 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.491 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2024-09-10T07:59:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2024-09-10T07:59:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.493 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.493 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T07:59:15.493 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.493 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.493 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.494 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2024-09-10T07:59:15.494 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2024-09-10T07:59:15.494 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.494 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.494 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.494 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2024-09-10T07:59:15.494 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.495 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.495 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.495 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2024-09-10T07:59:15.495 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.495 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.495 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.495 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2024-09-10T07:59:15.496 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2024-09-10T07:59:15.496 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.496 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.496 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.496 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.496 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.496 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.496 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.497 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T07:59:15.497 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.497 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.497 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.497 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2024-09-10T07:59:15.497 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2024-09-10T07:59:15.497 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.498 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.498 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.498 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.498 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.498 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.498 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.498 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T07:59:15.498 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.498 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.499 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.499 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2024-09-10T07:59:15.499 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2024-09-10T07:59:15.499 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.499 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.499 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.500 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.500 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.500 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.500 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.500 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T07:59:15.500 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.500 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.500 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.501 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2024-09-10T07:59:15.501 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2024-09-10T07:59:15.501 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.501 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.501 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.501 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.501 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.502 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.502 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.502 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T07:59:15.502 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.502 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.502 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.502 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2024-09-10T07:59:15.503 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2024-09-10T07:59:15.503 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.503 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.503 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.503 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.503 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.503 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.504 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.504 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T07:59:15.504 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.504 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.504 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.504 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2024-09-10T07:59:15.505 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2024-09-10T07:59:15.505 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.505 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.505 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.505 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.505 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.505 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.505 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.505 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T07:59:15.506 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.506 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.506 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.506 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.506 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.506 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2024-09-10T07:59:15.507 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.507 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.507 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.507 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.507 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.507 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.507 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.507 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.507 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.508 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.508 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.508 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.508 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.508 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.508 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.508 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.508 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.509 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.509 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.509 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.509 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.509 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.509 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.509 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.511 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.511 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.511 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.511 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.511 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.511 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.511 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.512 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.512 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.512 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.512 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.512 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.512 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.512 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.512 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.513 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.513 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.513 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.513 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.513 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.513 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.513 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.513 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.514 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.514 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.514 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.514 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.514 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.514 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.514 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.514 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.515 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.515 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.515 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.515 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.515 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.515 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2024-09-10T07:59:15.515 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2024-09-10T07:59:15.516 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.516 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.516 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.516 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2024-09-10T07:59:15.516 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.516 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.516 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.516 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T07:59:15.517 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.517 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.517 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.517 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2024-09-10T07:59:15.517 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2024-09-10T07:59:15.517 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.517 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.517 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.518 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2024-09-10T07:59:15.518 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.518 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.518 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.518 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T07:59:15.518 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.518 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.518 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.519 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2024-09-10T07:59:15.519 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.519 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.519 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.520 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T07:59:15.520 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T07:59:15.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.520 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.520 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.520 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:15.520 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.520 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.521 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.521 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.521 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.521 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.521 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.521 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T07:59:15.521 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T07:59:15.522 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.522 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.522 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.522 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.522 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.522 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.522 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.522 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.523 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.523 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.523 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.523 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T07:59:15.523 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T07:59:15.523 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.524 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.524 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.524 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.524 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.524 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.524 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.524 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.524 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.525 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.525 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.525 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2024-09-10T07:59:15.525 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T07:59:15.525 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.525 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.525 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.527 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T07:59:15.527 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T07:59:15.527 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.527 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.527 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.527 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.527 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.528 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.528 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.528 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.528 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.528 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.528 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.528 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T07:59:15.529 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T07:59:15.529 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.529 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.529 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.529 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.529 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.529 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.529 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.530 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.530 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.530 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.530 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.530 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T07:59:15.530 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T07:59:15.530 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.531 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.531 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.531 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.531 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.531 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.531 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.531 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.531 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.532 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.532 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.532 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T07:59:15.532 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T07:59:15.532 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.532 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.532 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.533 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.533 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.533 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.533 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.533 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.533 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.533 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.533 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.534 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T07:59:15.534 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T07:59:15.534 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.534 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.534 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.534 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.534 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.534 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.535 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.535 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.535 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.535 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.535 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.535 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T07:59:15.535 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T07:59:15.536 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.536 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.536 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.536 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.536 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.536 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.536 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.536 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.537 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.537 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.537 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.537 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T07:59:15.537 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T07:59:15.537 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.537 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.538 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.538 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.538 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.538 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.538 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.538 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.538 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.538 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.538 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.539 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T07:59:15.539 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T07:59:15.539 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.539 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.539 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.539 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.539 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.540 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.540 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.540 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.540 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.540 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.540 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.540 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T07:59:15.541 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T07:59:15.541 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.541 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.541 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.541 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.541 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.541 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.541 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.542 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.542 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.542 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.542 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.542 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T07:59:15.542 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T07:59:15.542 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.542 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.543 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.543 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.543 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.543 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.543 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.543 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.543 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.543 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.543 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.544 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T07:59:15.544 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T07:59:15.544 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.544 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.544 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.544 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-10T07:59:15.544 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T07:59:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T07:59:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2024-09-10T07:59:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2024-09-10T07:59:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T07:59:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T07:59:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-10T07:59:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T07:59:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T07:59:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T07:59:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T07:59:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T07:59:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T07:59:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T07:59:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T07:59:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T07:59:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T07:59:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T07:59:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T07:59:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T07:59:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T07:59:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T07:59:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T07:59:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.565 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.565 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T07:59:15.565 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T07:59:15.565 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.565 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.566 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.566 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.566 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.566 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.566 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.566 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.567 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.567 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.567 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.567 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T07:59:15.567 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T07:59:15.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.567 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.567 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.568 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.568 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.568 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.568 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.568 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.568 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.568 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.568 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.569 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T07:59:15.569 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T07:59:15.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.569 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.569 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.569 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.570 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.570 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.570 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.570 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.570 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.571 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T07:59:15.571 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T07:59:15.571 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.571 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.571 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.571 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.571 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.571 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.571 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.572 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.572 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.572 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.572 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.572 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T07:59:15.572 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T07:59:15.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.573 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.573 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.573 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.573 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.573 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.573 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.573 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.573 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T07:59:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T07:59:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.576 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T07:59:15.576 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T07:59:15.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.576 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.576 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T07:59:15.577 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.577 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.577 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.577 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.577 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.577 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.577 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T07:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T07:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.579 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.579 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.579 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.579 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.579 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T07:59:15.579 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T07:59:15.579 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2024-09-10T07:59:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.581 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.581 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.581 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T07:59:15.581 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T07:59:15.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.581 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.581 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.582 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2024-09-10T07:59:15.582 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.582 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.582 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.582 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.582 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.582 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.582 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.583 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T07:59:15.583 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T07:59:15.583 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.583 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.583 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.583 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.583 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.584 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.584 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.584 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.584 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.584 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.584 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.584 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T07:59:15.585 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T07:59:15.585 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.585 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.585 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.585 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2024-09-10T07:59:15.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.585 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.585 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.586 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.586 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.586 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.586 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T07:59:15.586 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T07:59:15.586 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.586 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.587 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.587 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.587 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.587 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.587 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.587 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.587 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.587 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.588 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.588 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T07:59:15.588 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T07:59:15.588 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.588 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.588 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.588 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.588 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.589 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.589 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.589 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.589 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.589 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.589 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.589 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T07:59:15.590 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T07:59:15.590 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.590 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.590 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.590 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:15.590 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.590 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.590 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.591 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.591 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.591 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.591 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.591 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T07:59:15.591 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T07:59:15.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.592 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.592 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.592 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:15.592 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.592 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.592 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.593 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.593 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.593 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.593 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.593 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T07:59:15.593 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T07:59:15.594 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.594 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.594 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.594 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:15.594 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.594 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.594 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.594 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.595 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.595 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.595 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.595 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2024-09-10T07:59:15.595 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2024-09-10T07:59:15.595 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.595 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.596 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.596 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.596 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.596 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.596 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.596 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.596 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.596 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.596 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.597 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2024-09-10T07:59:15.597 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2024-09-10T07:59:15.597 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.597 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.597 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.597 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.597 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.598 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.598 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.598 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.598 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.598 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.598 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.598 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2024-09-10T07:59:15.598 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2024-09-10T07:59:15.599 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.599 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.599 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.599 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.599 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.599 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.599 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.599 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2024-09-10T07:59:15.599 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.600 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.600 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.600 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2024-09-10T07:59:15.600 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2024-09-10T07:59:15.600 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.600 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.600 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.601 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2024-09-10T07:59:15.601 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.601 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.601 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.601 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.601 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.601 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.601 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.602 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-10T07:59:15.602 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-10T07:59:15.602 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.602 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.602 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.602 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.602 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2024-09-10T07:59:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2024-09-10T07:59:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2024-09-10T07:59:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2024-09-10T07:59:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T07:59:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-10T07:59:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-10T07:59:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-10T07:59:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-10T07:59:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-10T07:59:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2024-09-10T07:59:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-10T07:59:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-10T07:59:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2024-09-10T07:59:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2024-09-10T07:59:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2024-09-10T07:59:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-10T07:59:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-10T07:59:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2024-09-10T07:59:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2024-09-10T07:59:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-10T07:59:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-10T07:59:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-10T07:59:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-10T07:59:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-10T07:59:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2024-09-10T07:59:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2024-09-10T07:59:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2024-09-10T07:59:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2024-09-10T07:59:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2024-09-10T07:59:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2024-09-10T07:59:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2024-09-10T07:59:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2024-09-10T07:59:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2024-09-10T07:59:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T07:59:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2024-09-10T07:59:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2024-09-10T07:59:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2024-09-10T07:59:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T07:59:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2024-09-10T07:59:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2024-09-10T07:59:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2024-09-10T07:59:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2024-09-10T07:59:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2024-09-10T07:59:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2024-09-10T07:59:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-10T07:59:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T07:59:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2024-09-10T07:59:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2024-09-10T07:59:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T07:59:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T07:59:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2024-09-10T07:59:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2024-09-10T07:59:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2024-09-10T07:59:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T07:59:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2024-09-10T07:59:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2024-09-10T07:59:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2024-09-10T07:59:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2024-09-10T07:59:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2024-09-10T07:59:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2024-09-10T07:59:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2024-09-10T07:59:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2024-09-10T07:59:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2024-09-10T07:59:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2024-09-10T07:59:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2024-09-10T07:59:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2024-09-10T07:59:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2024-09-10T07:59:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2024-09-10T07:59:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T07:59:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2024-09-10T07:59:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2024-09-10T07:59:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2024-09-10T07:59:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T07:59:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2024-09-10T07:59:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2024-09-10T07:59:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2024-09-10T07:59:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2024-09-10T07:59:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2024-09-10T07:59:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T07:59:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2024-09-10T07:59:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2024-09-10T07:59:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2024-09-10T07:59:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2024-09-10T07:59:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2024-09-10T07:59:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2024-09-10T07:59:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2024-09-10T07:59:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2024-09-10T07:59:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2024-09-10T07:59:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2024-09-10T07:59:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T07:59:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2024-09-10T07:59:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2024-09-10T07:59:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2024-09-10T07:59:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T07:59:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2024-09-10T07:59:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2024-09-10T07:59:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2024-09-10T07:59:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2024-09-10T07:59:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2024-09-10T07:59:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2024-09-10T07:59:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T07:59:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2024-09-10T07:59:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2024-09-10T07:59:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "k8sevents", 2024-09-10T07:59:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_event_retention_days": { 2024-09-10T07:59:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ceph_event_retention_days", 2024-09-10T07:59:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7", 2024-09-10T07:59:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T07:59:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "config_check_secs": { 2024-09-10T07:59:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_check_secs", 2024-09-10T07:59:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "10", 2024-09-10T07:59:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T07:59:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2024-09-10T07:59:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2024-09-10T07:59:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2024-09-10T07:59:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2024-09-10T07:59:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2024-09-10T07:59:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T07:59:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2024-09-10T07:59:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2024-09-10T07:59:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2024-09-10T07:59:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T07:59:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2024-09-10T07:59:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2024-09-10T07:59:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2024-09-10T07:59:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2024-09-10T07:59:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2024-09-10T07:59:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2024-09-10T07:59:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2024-09-10T07:59:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T07:59:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2024-09-10T07:59:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2024-09-10T07:59:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2024-09-10T07:59:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2024-09-10T07:59:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2024-09-10T07:59:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2024-09-10T07:59:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T07:59:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T07:59:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mds_autoscaler", 2024-09-10T07:59:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2024-09-10T07:59:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2024-09-10T07:59:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.771 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.771 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.771 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.771 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.771 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.771 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.771 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.771 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.772 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.772 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.772 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.772 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.772 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.772 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.772 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.772 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.772 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-10T07:59:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2024-09-10T07:59:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2024-09-10T07:59:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.777 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T07:59:15.777 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.777 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.777 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.777 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.777 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.779 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.779 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.779 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.779 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.779 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.779 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.779 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.780 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.780 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.780 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.780 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.780 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.780 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.780 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.781 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.781 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.781 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.781 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.781 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.781 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.781 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.782 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.782 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.782 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.782 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.782 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.782 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.782 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.782 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.783 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.783 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.783 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.783 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.783 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.783 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.783 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.783 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.784 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.784 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.784 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.784 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.784 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.784 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.784 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.785 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.785 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.785 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.785 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.785 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.785 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.785 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.785 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.785 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.786 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.786 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2024-09-10T07:59:15.786 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2024-09-10T07:59:15.786 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.786 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.786 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.786 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.787 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.787 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.787 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.787 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2024-09-10T07:59:15.787 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2024-09-10T07:59:15.787 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2024-09-10T07:59:15.787 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.787 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2024-09-10T07:59:15.788 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.788 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.788 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2024-09-10T07:59:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.790 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.790 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.790 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.790 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.790 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.790 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.790 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.791 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.791 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.791 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.791 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.791 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.791 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.791 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.791 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.792 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.792 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.792 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.792 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.792 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.792 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.793 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.793 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.793 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.793 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.793 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.793 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.793 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.794 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.794 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.794 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.794 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.794 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.794 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.794 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.794 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.795 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.795 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.795 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.795 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.795 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.795 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.795 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.795 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.795 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.796 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.796 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.796 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.796 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.796 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.796 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.797 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.797 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.797 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.797 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.797 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.797 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.797 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.797 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.798 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.798 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2024-09-10T07:59:15.798 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.798 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.798 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.799 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.799 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.799 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.799 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.799 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.799 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.799 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.800 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.800 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.800 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.800 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.800 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.800 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.800 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.800 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.801 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.801 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.801 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.801 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.801 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.801 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.801 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.802 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.802 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.802 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.802 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.802 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.802 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.802 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.803 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.803 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.803 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.803 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.803 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.803 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.804 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.804 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.804 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.804 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.804 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.804 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.804 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.804 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.805 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.805 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.805 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.805 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.805 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.805 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.805 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.805 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.806 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.806 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.806 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.806 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.806 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.807 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.807 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.807 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.807 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.807 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.807 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.807 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.807 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.808 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2024-09-10T07:59:15.808 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.808 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.808 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.808 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.808 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.809 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.809 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.809 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.809 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.809 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.809 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.809 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.809 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.810 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.810 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.810 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.810 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.810 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.810 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.810 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.810 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.811 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.811 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.811 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.811 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.811 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.811 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.812 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.812 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.812 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.812 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.812 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.812 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.812 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.812 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.813 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.813 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.813 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.813 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.813 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.813 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.813 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.814 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.814 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.814 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.814 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.814 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.814 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.814 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.814 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.815 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.815 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.815 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.815 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.815 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.815 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.815 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.816 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.816 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.816 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.816 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.816 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.816 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.816 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.816 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.816 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.817 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.817 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:15.817 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:15.817 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.817 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.817 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.817 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.818 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2024-09-10T07:59:15.819 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2024-09-10T07:59:15.819 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.819 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.819 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.819 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2024-09-10T07:59:15.819 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2024-09-10T07:59:15.819 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.819 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.820 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2024-09-10T07:59:15.820 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T07:59:15.820 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.820 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.820 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.820 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.821 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2024-09-10T07:59:15.821 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.821 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.821 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.821 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2024-09-10T07:59:15.821 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2024-09-10T07:59:15.821 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.821 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.821 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.822 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.822 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.822 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.822 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.822 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T07:59:15.822 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.822 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.822 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.823 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-10T07:59:15.823 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-10T07:59:15.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.823 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.823 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.823 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.823 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.823 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.824 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.824 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.824 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.824 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.824 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.824 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.825 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.825 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.825 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.825 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.825 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.825 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.825 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.825 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.826 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.826 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.826 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.826 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.826 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.826 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.826 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.826 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.827 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.827 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.827 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.827 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.827 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.827 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.827 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.828 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.828 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.828 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.828 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.828 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.828 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.828 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.828 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.829 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.829 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.829 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.829 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.829 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.829 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.829 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.830 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.830 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.830 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.830 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.830 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.830 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.830 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.830 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.831 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.831 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.831 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.831 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.831 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.831 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.831 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.832 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.832 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.832 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.832 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.832 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.832 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.832 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.832 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.833 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.833 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.833 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.833 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.833 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2024-09-10T07:59:15.833 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2024-09-10T07:59:15.833 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.834 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.834 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.834 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2024-09-10T07:59:15.834 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.834 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.834 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.834 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2024-09-10T07:59:15.834 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.835 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.835 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.835 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2024-09-10T07:59:15.835 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2024-09-10T07:59:15.835 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.835 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.835 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.835 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2024-09-10T07:59:15.836 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.836 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.836 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.836 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2024-09-10T07:59:15.836 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.836 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.836 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.837 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.837 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.837 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2024-09-10T07:59:15.837 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.837 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.837 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.838 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2024-09-10T07:59:15.838 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2024-09-10T07:59:15.838 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.838 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.838 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.838 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.838 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.839 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.839 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.839 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.839 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.839 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.839 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.839 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2024-09-10T07:59:15.840 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2024-09-10T07:59:15.840 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.840 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.840 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.840 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.840 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.840 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.841 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.841 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T07:59:15.841 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T07:59:15.841 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.841 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.841 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.842 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.842 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.842 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.842 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.842 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.842 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.842 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.843 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.843 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.843 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.843 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.843 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.843 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.843 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.843 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.843 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.844 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.844 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.844 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.844 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.844 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.844 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.844 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.845 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.845 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.845 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.845 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.845 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.845 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.845 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.845 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.846 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.846 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.846 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.846 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.846 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.846 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.846 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.847 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.847 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.847 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.847 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.847 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.847 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.847 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.847 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.848 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.848 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.848 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.848 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.848 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.849 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.849 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.849 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.849 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.849 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.849 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.849 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.849 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.850 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.850 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.850 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.850 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.850 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.850 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2024-09-10T07:59:15.851 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2024-09-10T07:59:15.851 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.851 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.851 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.851 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.851 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.851 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.851 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.851 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.852 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.852 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.852 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.852 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T07:59:15.852 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T07:59:15.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.852 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.853 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.853 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2024-09-10T07:59:15.853 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.853 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.853 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.853 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.853 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.853 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.854 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.854 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2024-09-10T07:59:15.854 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2024-09-10T07:59:15.854 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.854 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.854 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.854 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2024-09-10T07:59:15.855 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.855 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.855 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.855 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.855 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.855 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.855 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.855 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-10T07:59:15.856 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-10T07:59:15.856 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.856 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.856 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.856 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2024-09-10T07:59:15.856 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.856 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.856 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.857 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T07:59:15.857 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.857 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.857 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.857 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-10T07:59:15.857 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-10T07:59:15.857 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.858 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.858 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.858 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2024-09-10T07:59:15.858 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.858 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.858 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.858 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T07:59:15.858 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.859 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.859 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.859 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2024-09-10T07:59:15.859 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2024-09-10T07:59:15.859 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.859 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.859 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.860 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2024-09-10T07:59:15.860 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.860 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.860 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.860 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.860 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.860 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.861 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.861 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2024-09-10T07:59:15.861 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2024-09-10T07:59:15.861 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.861 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.861 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.861 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2024-09-10T07:59:15.861 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.862 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.862 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.862 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2024-09-10T07:59:15.862 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2024-09-10T07:59:15.862 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.862 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.862 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.862 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.863 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.863 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2024-09-10T07:59:15.863 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2024-09-10T07:59:15.863 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.863 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.863 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.863 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2024-09-10T07:59:15.864 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2024-09-10T07:59:15.864 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2024-09-10T07:59:15.864 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.864 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.864 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.864 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.864 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.864 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.865 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.865 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2024-09-10T07:59:15.865 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.865 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.865 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.865 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.866 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.866 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.866 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.866 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.866 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.866 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.866 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.866 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.867 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.867 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.867 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.867 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.867 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.867 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.867 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.867 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.868 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.868 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.868 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.868 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.868 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.868 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.868 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.869 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.869 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.869 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.869 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.869 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.869 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.869 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.870 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.870 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.870 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.870 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.870 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.870 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.871 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.871 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.871 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.871 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.871 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.871 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.871 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.871 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.872 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.872 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.872 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.872 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.872 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.872 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.872 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.873 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.873 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.873 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.873 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.873 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.873 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.873 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.874 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.874 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.874 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.874 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.874 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.874 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.874 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.875 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2024-09-10T07:59:15.875 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2024-09-10T07:59:15.875 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.875 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.875 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.875 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2024-09-10T07:59:15.875 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.875 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.876 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.876 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.876 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.876 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.876 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.876 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2024-09-10T07:59:15.876 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T07:59:15.877 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.877 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.877 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.877 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.877 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.877 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.877 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.878 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.878 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.878 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.878 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2024-09-10T07:59:15.878 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2024-09-10T07:59:15.878 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.878 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.878 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.879 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.879 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.879 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.879 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.879 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.879 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.879 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.879 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.880 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.880 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.880 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2024-09-10T07:59:15.880 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.880 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.880 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.881 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2024-09-10T07:59:15.881 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2024-09-10T07:59:15.881 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.881 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.881 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.881 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.881 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.881 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.882 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.882 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.882 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.882 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.882 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.882 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2024-09-10T07:59:15.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2024-09-10T07:59:15.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.883 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.883 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.883 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.883 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.883 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.883 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.883 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.883 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.884 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.884 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.884 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.884 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.884 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.884 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.885 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.885 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.885 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.885 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.885 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.885 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.885 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.885 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.885 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.886 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.886 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.886 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.886 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.886 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.886 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.886 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.887 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.887 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.887 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.887 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.887 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.887 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.887 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.887 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.888 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.888 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.888 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.888 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.888 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.888 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.889 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.889 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.889 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.889 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.890 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.890 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.890 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.890 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.890 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.890 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.890 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.890 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.890 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.891 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.891 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.891 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.891 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.891 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.891 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.891 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.892 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.892 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.892 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.892 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.892 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.892 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.892 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.892 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.893 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.893 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2024-09-10T07:59:15.893 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2024-09-10T07:59:15.893 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.893 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.893 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.893 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.894 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.894 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.894 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.894 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.894 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.894 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.894 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.895 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2024-09-10T07:59:15.895 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2024-09-10T07:59:15.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.895 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.895 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.895 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.895 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.895 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.896 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.896 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.896 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.896 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.896 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.896 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.896 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.897 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rgw", 2024-09-10T07:59:15.897 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.897 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.897 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.897 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.898 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.898 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.898 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.898 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.898 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.898 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.898 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.899 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.899 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.899 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.899 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.899 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.899 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.899 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.899 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.900 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.900 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.900 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.900 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.900 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.900 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.900 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.901 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.901 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.901 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.901 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.901 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.901 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.901 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.901 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.902 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.902 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.902 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.902 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.902 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.902 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.903 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.903 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.903 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.903 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.903 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.903 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.903 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.903 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.904 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.904 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.904 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.904 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.904 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.904 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.904 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.905 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.905 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.905 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.905 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.905 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.905 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.905 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.906 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.906 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.906 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.906 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.906 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.906 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.907 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rook", 2024-09-10T07:59:15.907 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.907 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.907 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.907 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.907 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.907 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.907 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.908 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.908 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.908 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.908 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.908 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.908 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.908 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.909 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.909 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.909 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.909 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.909 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.909 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.909 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.909 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.910 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.910 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.910 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.910 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.910 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.910 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.910 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.911 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.911 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.911 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.911 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.911 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.911 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.911 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.912 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.912 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.912 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.912 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.912 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.912 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.912 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.913 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.913 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.913 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.913 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.913 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.913 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.913 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.913 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.914 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.914 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.914 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.914 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.914 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.914 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.914 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.914 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.915 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.915 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.915 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.915 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.915 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.915 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.915 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.915 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.916 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.916 INFO:teuthology.orchestra.run.smithi073.stdout: "storage_class": { 2024-09-10T07:59:15.916 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "storage_class", 2024-09-10T07:59:15.916 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.916 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.916 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "local", 2024-09-10T07:59:15.917 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.917 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.917 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.917 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T07:59:15.917 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.917 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.917 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.917 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.918 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2024-09-10T07:59:15.918 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.918 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.918 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.918 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.919 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.919 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.919 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.919 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.919 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.919 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.919 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.919 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.920 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.920 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.920 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.920 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.920 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.920 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.920 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.920 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.921 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.921 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.921 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.921 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.921 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.921 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.921 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.921 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.922 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.922 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.922 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.922 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.922 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.922 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.922 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.922 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.923 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.923 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.923 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.923 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.923 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.923 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.924 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.924 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.924 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.924 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.924 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.924 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.924 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.924 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.925 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.925 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.925 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.925 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.925 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.925 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.925 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.926 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.926 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.926 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.926 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.926 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.926 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.926 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.926 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.927 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.927 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.927 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.927 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2024-09-10T07:59:15.927 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2024-09-10T07:59:15.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.927 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.928 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.928 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.928 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.928 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.928 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.928 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.928 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.928 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.929 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.929 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2024-09-10T07:59:15.929 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2024-09-10T07:59:15.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.929 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.929 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2024-09-10T07:59:15.930 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.930 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.930 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.930 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.930 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.930 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.930 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.931 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2024-09-10T07:59:15.931 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2024-09-10T07:59:15.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.931 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.931 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.931 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.931 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.932 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.932 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.932 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.932 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.932 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.932 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.932 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2024-09-10T07:59:15.933 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2024-09-10T07:59:15.933 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.933 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.933 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.933 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.933 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.933 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.933 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.934 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.934 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.934 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.934 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.934 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2024-09-10T07:59:15.934 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2024-09-10T07:59:15.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2024-09-10T07:59:15.935 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.935 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.935 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.935 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.935 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.935 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.935 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.936 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.936 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2024-09-10T07:59:15.936 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2024-09-10T07:59:15.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.936 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.936 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.937 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.937 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.937 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.937 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.937 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.937 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.937 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.937 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.938 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2024-09-10T07:59:15.938 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2024-09-10T07:59:15.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.938 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.938 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.938 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.938 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.938 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.938 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.939 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.939 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.939 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.939 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.939 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2024-09-10T07:59:15.939 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2024-09-10T07:59:15.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.939 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.940 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.940 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.940 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.940 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.940 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.940 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.940 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.940 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.941 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.941 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2024-09-10T07:59:15.941 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2024-09-10T07:59:15.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:15.941 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.941 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.941 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.941 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2024-09-10T07:59:15.942 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2024-09-10T07:59:15.942 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.942 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.942 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.942 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.942 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2024-09-10T07:59:15.943 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2024-09-10T07:59:15.943 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.943 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.943 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.943 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.943 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.943 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.943 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.943 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.944 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.944 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.944 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.944 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2024-09-10T07:59:15.944 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2024-09-10T07:59:15.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.944 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.945 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.945 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.945 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.945 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.945 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.945 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.945 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.946 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.946 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2024-09-10T07:59:15.946 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2024-09-10T07:59:15.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.946 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.946 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.947 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.947 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.947 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.947 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.947 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.947 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.947 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.947 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.948 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2024-09-10T07:59:15.948 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.948 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.948 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.949 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2024-09-10T07:59:15.949 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2024-09-10T07:59:15.949 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.949 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.949 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.949 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.949 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.949 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.950 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.950 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T07:59:15.950 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.950 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.950 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.950 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2024-09-10T07:59:15.950 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2024-09-10T07:59:15.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.951 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.951 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.951 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.951 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.951 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.951 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.951 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2024-09-10T07:59:15.952 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.952 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.952 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.952 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.952 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.952 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.952 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.953 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.953 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.953 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.953 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.953 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.953 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.953 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.954 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.954 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.954 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.954 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.954 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.954 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.954 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.954 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.955 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.955 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.955 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.955 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.955 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.955 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.956 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.956 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.956 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.956 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.956 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.956 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.956 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.957 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.957 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.957 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.957 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.957 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.957 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.957 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.957 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.958 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.958 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.958 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.958 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.958 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.958 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.958 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.958 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.958 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.959 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.959 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.959 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.959 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.959 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.959 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.959 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.960 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.960 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.960 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.960 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.960 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.960 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.960 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.960 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.961 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.961 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.961 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2024-09-10T07:59:15.961 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.961 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.961 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.961 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.962 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.962 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.962 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.962 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.962 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.962 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.962 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.962 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.963 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.963 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.963 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.963 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.963 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.963 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.963 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.963 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.964 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.965 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.966 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.967 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.968 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.969 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.970 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.970 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.970 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.970 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.970 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2024-09-10T07:59:15.971 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.971 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.971 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.971 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.971 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.971 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.971 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.972 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.972 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.972 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.972 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.972 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.972 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.972 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.973 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.973 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.973 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.973 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.973 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.973 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.973 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.973 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.974 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.974 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.974 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.974 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.974 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.974 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.974 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.975 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.975 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.975 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.975 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.975 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.975 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.975 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.976 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.976 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.976 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.976 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.976 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.976 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.976 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.976 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.977 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.977 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.977 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.977 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.977 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.977 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.977 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.977 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.978 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.978 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.978 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.978 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.978 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.978 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.978 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.979 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.979 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.979 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.979 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.979 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.979 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.979 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.980 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2024-09-10T07:59:15.980 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.980 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.980 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.980 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2024-09-10T07:59:15.980 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2024-09-10T07:59:15.981 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.981 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.981 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.981 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T07:59:15.981 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.981 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.981 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.981 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:15.983 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.983 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.983 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2024-09-10T07:59:15.983 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.983 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.983 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.983 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.983 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.984 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.984 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.984 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:15.984 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:15.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.984 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.985 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:15.985 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.985 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.985 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.985 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.985 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.985 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.985 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.986 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.986 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.986 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.986 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.986 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.986 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.986 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.987 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:15.987 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:15.987 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.987 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.987 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.987 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.987 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.987 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:15.989 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:15.989 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.989 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.989 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:15.989 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.989 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.989 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:15.989 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:15.990 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:15.990 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:15.990 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:15.990 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:15.990 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:15.990 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:15.990 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.990 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.991 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.991 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.991 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:15.991 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:15.991 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.991 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.992 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:15.992 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:15.992 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.992 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.992 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.992 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:15.992 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.992 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.993 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.993 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.993 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:15.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:15.993 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2024-09-10T07:59:15.993 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:15.994 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:15.994 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:15.994 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2024-09-10T07:59:15.994 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2024-09-10T07:59:15.994 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.994 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.994 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.994 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.995 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.995 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.995 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.995 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T07:59:15.995 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.995 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.995 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.996 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2024-09-10T07:59:15.996 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2024-09-10T07:59:15.996 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.996 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.996 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.996 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.996 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.996 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.997 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.997 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T07:59:15.997 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.997 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.997 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.997 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2024-09-10T07:59:15.997 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2024-09-10T07:59:15.998 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.998 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.998 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:15.998 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:15.998 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:15.998 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:15.998 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:15.998 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T07:59:15.999 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:15.999 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:15.999 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:15.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:15.999 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2024-09-10T07:59:15.999 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2024-09-10T07:59:15.999 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:15.999 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:15.999 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.000 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.000 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.000 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.000 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.000 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T07:59:16.000 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.000 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.001 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.001 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2024-09-10T07:59:16.001 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2024-09-10T07:59:16.001 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.001 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.001 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.001 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.002 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.002 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.002 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.002 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T07:59:16.002 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.002 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.002 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2024-09-10T07:59:16.003 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2024-09-10T07:59:16.003 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.003 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.003 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.003 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.003 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.003 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.003 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.004 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.004 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.004 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.004 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.004 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2024-09-10T07:59:16.004 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2024-09-10T07:59:16.004 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.005 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.005 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.005 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.005 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.005 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.005 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.005 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.005 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.006 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.006 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.006 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2024-09-10T07:59:16.006 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2024-09-10T07:59:16.006 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.006 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.006 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T07:59:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.008 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2024-09-10T07:59:16.008 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2024-09-10T07:59:16.008 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.008 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.008 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.008 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.008 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.008 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.009 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.009 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.009 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.009 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.009 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.009 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:16.009 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:16.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:16.010 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.010 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.010 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2024-09-10T07:59:16.010 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2024-09-10T07:59:16.010 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.010 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.010 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.010 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.011 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.011 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.011 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2024-09-10T07:59:16.011 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2024-09-10T07:59:16.011 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:16.011 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.011 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.012 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2024-09-10T07:59:16.012 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.012 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.012 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.012 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.012 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.012 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.012 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.013 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2024-09-10T07:59:16.013 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2024-09-10T07:59:16.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.013 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.013 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.013 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.014 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.014 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.014 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.014 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.014 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.014 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.014 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.015 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2024-09-10T07:59:16.015 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2024-09-10T07:59:16.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.015 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.015 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.015 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.015 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.015 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.016 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.016 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.016 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.016 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.016 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.016 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:16.016 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:16.017 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.017 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.017 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.017 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.017 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.017 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.017 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:16.017 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:16.018 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:16.018 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:16.018 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:16.018 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:16.018 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:16.018 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.018 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.018 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.019 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.020 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.020 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.020 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.020 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.020 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.020 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.020 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.021 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:16.021 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:16.021 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.021 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.021 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.021 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:16.021 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.021 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.022 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:16.022 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:16.022 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:16.022 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:16.022 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:16.022 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:16.022 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:16.022 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.023 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.023 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.023 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.023 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.023 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:16.023 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:16.023 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.023 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.024 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.024 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.024 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.024 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.024 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.024 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.024 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.025 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.025 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.025 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2024-09-10T07:59:16.025 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2024-09-10T07:59:16.025 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.025 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.025 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.026 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.026 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.026 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.026 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.026 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.026 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.026 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.026 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.027 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2024-09-10T07:59:16.027 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2024-09-10T07:59:16.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.027 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.027 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.027 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.028 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.028 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.028 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.028 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.028 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.028 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.028 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.029 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2024-09-10T07:59:16.029 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2024-09-10T07:59:16.029 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.029 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.029 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.029 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T07:59:16.029 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.029 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.029 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.030 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.030 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.030 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.030 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.030 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.030 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.030 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2024-09-10T07:59:16.031 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:16.031 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:16.031 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:16.031 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:16.031 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:16.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.031 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.031 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.032 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.032 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.032 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.032 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:16.032 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:16.032 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:16.032 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.034 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:16.034 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:16.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.034 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.034 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.034 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.034 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.034 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.034 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.035 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.035 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.035 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.035 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.035 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:16.035 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:16.035 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.035 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.036 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.036 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:16.036 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.036 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.036 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:16.036 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:16.036 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:16.036 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:16.037 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:16.037 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:16.037 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:16.037 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.037 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.037 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.037 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.037 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.038 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:16.038 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:16.038 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.038 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.038 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.038 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.039 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.039 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.039 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.039 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.039 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.039 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.039 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.040 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2024-09-10T07:59:16.040 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:16.040 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:16.040 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:16.040 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:16.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:16.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.041 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.041 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.041 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.041 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.041 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.041 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:16.041 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:16.042 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:16.042 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:16.042 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:16.042 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:16.042 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:16.042 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.042 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.042 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.043 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.043 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.043 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:16.043 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:16.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.043 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.043 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.043 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.044 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.044 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.044 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.044 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.044 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.044 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.044 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.045 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:16.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:16.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.045 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.045 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.045 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:16.045 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:16.047 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.048 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2024-09-10T07:59:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2024-09-10T07:59:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.049 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2024-09-10T07:59:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T07:59:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.050 INFO:teuthology.orchestra.run.smithi073.stdout: "periodic_async_work": { 2024-09-10T07:59:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "periodic_async_work", 2024-09-10T07:59:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.051 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Periodically check for async work", 2024-09-10T07:59:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2024-09-10T07:59:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2024-09-10T07:59:16.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:16.053 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.053 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.053 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2024-09-10T07:59:16.053 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.053 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.053 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.053 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T07:59:16.053 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.054 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.054 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.054 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_no_wait": { 2024-09-10T07:59:16.054 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T07:59:16.054 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.054 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.054 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.055 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2024-09-10T07:59:16.055 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.055 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.055 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.055 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T07:59:16.055 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.055 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.055 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.056 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2024-09-10T07:59:16.056 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2024-09-10T07:59:16.057 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2024-09-10T07:59:16.057 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2024-09-10T07:59:16.057 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2024-09-10T07:59:16.057 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2024-09-10T07:59:16.057 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2024-09-10T07:59:16.057 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.057 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.057 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2024-09-10T07:59:16.058 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.058 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.058 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.058 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.058 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.058 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.058 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.059 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2024-09-10T07:59:16.059 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2024-09-10T07:59:16.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.059 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.059 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.060 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.060 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.060 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.060 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.060 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.060 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.060 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.060 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2024-09-10T07:59:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2024-09-10T07:59:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2024-09-10T07:59:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2024-09-10T07:59:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2024-09-10T07:59:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2024-09-10T07:59:16.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.063 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.063 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.063 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.063 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.063 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.063 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:16.064 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:16.064 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:16.064 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:16.064 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:16.064 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:16.064 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:16.064 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.064 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2024-09-10T07:59:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2024-09-10T07:59:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.065 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.066 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2024-09-10T07:59:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2024-09-10T07:59:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2024-09-10T07:59:16.067 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.068 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.068 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2024-09-10T07:59:16.068 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2024-09-10T07:59:16.068 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2024-09-10T07:59:16.068 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2024-09-10T07:59:16.068 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2024-09-10T07:59:16.068 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2024-09-10T07:59:16.068 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2024-09-10T07:59:16.069 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.069 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.069 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.069 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.069 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2024-09-10T07:59:16.069 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2024-09-10T07:59:16.069 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2024-09-10T07:59:16.070 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.070 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-10T07:59:16.070 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2024-09-10T07:59:16.070 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.070 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.070 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.070 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.070 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.071 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.071 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2024-09-10T07:59:16.071 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2024-09-10T07:59:16.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.071 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.071 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.072 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2024-09-10T07:59:16.072 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.072 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.072 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.072 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.072 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.072 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.072 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.073 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2024-09-10T07:59:16.073 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2024-09-10T07:59:16.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2024-09-10T07:59:16.073 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.073 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.073 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2024-09-10T07:59:16.073 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.074 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.074 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.074 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.074 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.074 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.074 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.074 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2024-09-10T07:59:16.075 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2024-09-10T07:59:16.075 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2024-09-10T07:59:16.075 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2024-09-10T07:59:16.075 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2024-09-10T07:59:16.075 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T07:59:16.075 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2024-09-10T07:59:16.075 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2024-09-10T07:59:16.075 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2024-09-10T07:59:16.076 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2024-09-10T07:59:16.076 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2024-09-10T07:59:16.076 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-10T07:59:16.076 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2024-09-10T07:59:16.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.076 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.077 INFO:teuthology.orchestra.run.smithi073.stdout: "services": { 2024-09-10T07:59:16.077 INFO:teuthology.orchestra.run.smithi073.stdout: "dashboard": "https://172.21.15.73:8443/" 2024-09-10T07:59:16.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.077 INFO:teuthology.orchestra.run.smithi073.stdout: "always_on_modules": { 2024-09-10T07:59:16.077 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus": [ 2024-09-10T07:59:16.077 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-10T07:59:16.077 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-10T07:59:16.077 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-10T07:59:16.078 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-10T07:59:16.078 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-10T07:59:16.078 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-10T07:59:16.079 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-10T07:59:16.079 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-10T07:59:16.079 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-10T07:59:16.079 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-10T07:59:16.079 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.079 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific": [ 2024-09-10T07:59:16.079 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-10T07:59:16.079 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-10T07:59:16.080 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-10T07:59:16.080 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-10T07:59:16.080 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-10T07:59:16.080 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-10T07:59:16.080 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-10T07:59:16.080 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-10T07:59:16.080 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-10T07:59:16.080 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-10T07:59:16.080 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.081 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy": [ 2024-09-10T07:59:16.081 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-10T07:59:16.081 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-10T07:59:16.081 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-10T07:59:16.081 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-10T07:59:16.081 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-10T07:59:16.081 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-10T07:59:16.081 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-10T07:59:16.082 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-10T07:59:16.082 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-10T07:59:16.082 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-10T07:59:16.082 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.082 INFO:teuthology.orchestra.run.smithi073.stdout: "reef": [ 2024-09-10T07:59:16.082 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-10T07:59:16.082 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-10T07:59:16.082 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-10T07:59:16.083 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-10T07:59:16.083 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-10T07:59:16.083 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-10T07:59:16.083 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-10T07:59:16.083 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-10T07:59:16.083 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-10T07:59:16.083 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-10T07:59:16.083 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-10T07:59:16.084 INFO:teuthology.orchestra.run.smithi073.stdout: "squid": [ 2024-09-10T07:59:16.084 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2024-09-10T07:59:16.084 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-09-10T07:59:16.084 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2024-09-10T07:59:16.084 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2024-09-10T07:59:16.084 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2024-09-10T07:59:16.084 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2024-09-10T07:59:16.084 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2024-09-10T07:59:16.084 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2024-09-10T07:59:16.085 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2024-09-10T07:59:16.085 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2024-09-10T07:59:16.085 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:16.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.085 INFO:teuthology.orchestra.run.smithi073.stdout: "last_failure_osd_epoch": 86, 2024-09-10T07:59:16.085 INFO:teuthology.orchestra.run.smithi073.stdout: "active_clients": [ 2024-09-10T07:59:16.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.085 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2024-09-10T07:59:16.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-10T07:59:16.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-10T07:59:16.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-10T07:59:16.086 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 221591900 2024-09-10T07:59:16.086 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.086 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:16.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "libcephsqlite", 2024-09-10T07:59:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-10T07:59:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-10T07:59:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-10T07:59:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1721250871 2024-09-10T07:59:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:16.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.088 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2024-09-10T07:59:16.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-10T07:59:16.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-10T07:59:16.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-10T07:59:16.088 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 4009183802 2024-09-10T07:59:16.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.089 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:16.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.089 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2024-09-10T07:59:16.089 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-10T07:59:16.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.089 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-10T07:59:16.090 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-10T07:59:16.090 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3687505673 2024-09-10T07:59:16.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.090 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:16.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.090 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2024-09-10T07:59:16.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-10T07:59:16.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-10T07:59:16.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-10T07:59:16.091 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1909503312 2024-09-10T07:59:16.091 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.091 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:16.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.092 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2024-09-10T07:59:16.092 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-10T07:59:16.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-10T07:59:16.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-10T07:59:16.092 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2024-09-10T07:59:16.092 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 448609316 2024-09-10T07:59:16.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.092 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:16.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.093 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-10T07:59:16.093 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T07:59:16.094 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:14 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1202268679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T07:59:16.094 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:14 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/131904516' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T07:59:16.095 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:14 smithi159 ceph-mon[35522]: pgmap v313: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 13 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-10T07:59:16.095 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:14 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1202268679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T07:59:16.095 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:14 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/131904516' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T07:59:16.095 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:14 smithi102 ceph-mon[35514]: pgmap v313: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 13 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-10T07:59:16.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fd7300a2d00 msgr2=0x7fd7300a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:16.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fd7300a2d00 0x7fd7300a51c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd73c006010 tx=0x7fd73c009360 comp rx=0 tx=0).stop 2024-09-10T07:59:16.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 msgr2=0x7fd748197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:16.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 0x7fd748197320 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd74000eb00 tx=0x7fd74000ef00 comp rx=0 tx=0).stop 2024-09-10T07:59:16.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 shutdown_connections 2024-09-10T07:59:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fd7300a2d00 0x7fd7300a51c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd748106990 0x7fd74819bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748101320 0x7fd748197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 --2- 172.21.15.73:0/131904516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd748100980 0x7fd748197320 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 >> 172.21.15.73:0/131904516 conn(0x7fd748077a10 msgr2=0x7fd748103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 shutdown_connections 2024-09-10T07:59:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:13.622+0000 7fd74ccba640 1 -- 172.21.15.73:0/131904516 wait complete. 2024-09-10T07:59:16.105 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T07:59:16.106 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T07:59:16.106 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:14 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1202268679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T07:59:16.107 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:14 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/131904516' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T07:59:16.107 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:14 smithi073 ceph-mon[30850]: pgmap v313: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 13 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-10T07:59:16.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:16 smithi102 ceph-mon[35514]: pgmap v314: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 13 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-10T07:59:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:16.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:16 smithi159 ceph-mon[35522]: pgmap v314: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 13 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-10T07:59:16.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:16 smithi073 ceph-mon[30850]: pgmap v314: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 13 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-10T07:59:16.914 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T07:59:16.914 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:16.914 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 4, 2024-09-10T07:59:16.914 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 4, 2024-09-10T07:59:16.914 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 2992, 2024-09-10T07:59:16.915 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 448, 2024-09-10T07:59:16.915 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:16.915 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:16.915 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.003094454, 2024-09-10T07:59:16.915 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000052436, 2024-09-10T07:59:16.915 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.002158726, 2024-09-10T07:59:16.915 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:16.916 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:16.916 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3, 2024-09-10T07:59:16.916 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.003996133, 2024-09-10T07:59:16.916 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.001332044 2024-09-10T07:59:16.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.916 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:16.917 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:16.917 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:16.917 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:16.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.917 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T07:59:16.918 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T07:59:16.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.918 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:16.918 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 203, 2024-09-10T07:59:16.918 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 193, 2024-09-10T07:59:16.919 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1437360, 2024-09-10T07:59:16.919 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 118608, 2024-09-10T07:59:16.919 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:16.919 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:16.919 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.039570905, 2024-09-10T07:59:16.919 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.012385303, 2024-09-10T07:59:16.920 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.040321884, 2024-09-10T07:59:16.920 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:16.920 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:16.920 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 192, 2024-09-10T07:59:16.920 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.012972167, 2024-09-10T07:59:16.921 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000067563 2024-09-10T07:59:16.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.921 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:16.921 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:16.921 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:16.922 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:16.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.922 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 1437360, 2024-09-10T07:59:16.922 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 118608 2024-09-10T07:59:16.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.923 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:16.923 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 2, 2024-09-10T07:59:16.923 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 148, 2024-09-10T07:59:16.923 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 320, 2024-09-10T07:59:16.923 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 183184, 2024-09-10T07:59:16.923 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:16.924 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:16.924 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.011323720, 2024-09-10T07:59:16.924 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.007545234, 2024-09-10T07:59:16.924 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.001806301, 2024-09-10T07:59:16.924 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:16.925 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:16.925 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 145, 2024-09-10T07:59:16.925 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.015824275, 2024-09-10T07:59:16.925 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000109132 2024-09-10T07:59:16.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.926 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:16.926 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:16.926 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:16.926 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:16.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.927 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T07:59:16.927 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 183184 2024-09-10T07:59:16.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.927 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-10T07:59:16.927 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2024-09-10T07:59:16.928 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-10T07:59:16.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.928 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-10T07:59:16.928 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:16.928 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:16.928 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:16.929 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:16.929 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:16.929 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:16.929 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:16.929 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:16.930 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:16.930 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:16.930 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:16.930 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:16.930 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:16.930 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:16.930 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:16.930 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:16.931 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:16.931 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:16.931 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:16.931 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:16.931 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:16.931 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:16.931 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:16.931 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:16.931 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:16.932 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:16.932 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:16.932 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:16.932 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:16.932 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:16.932 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:16.932 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-10T07:59:16.932 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 148995, 2024-09-10T07:59:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 31, 2024-09-10T07:59:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-10T07:59:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-10T07:59:16.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:16.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:16.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:16.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:16.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:16.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2024-09-10T07:59:16.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:16.935 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:16.935 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:16.935 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-10T07:59:16.935 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:16.935 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2024-09-10T07:59:16.935 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:16.935 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-10T07:59:16.935 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:16.935 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-10T07:59:16.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:16.936 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:16.936 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-10T07:59:16.936 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-10T07:59:16.936 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-10T07:59:16.936 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 205, 2024-09-10T07:59:16.936 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 1408748, 2024-09-10T07:59:16.936 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:16.936 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 205, 2024-09-10T07:59:16.937 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-10T07:59:16.937 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-10T07:59:16.937 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 205, 2024-09-10T07:59:16.937 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1408748, 2024-09-10T07:59:16.937 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-10T07:59:16.937 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:16.937 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:16.938 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:16.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:16.938 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T07:59:17.830 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-10T07:59:17.830 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-10T07:59:17.830 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-10T07:59:17.830 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-10T07:59:17.830 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T07:59:17.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T07:59:18.084 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:18.213 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:18 smithi073 ceph-mon[30850]: pgmap v315: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 13 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 3.1 KiB/s rd, 198 B/s wr, 5 op/s 2024-09-10T07:59:18.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:18 smithi102 ceph-mon[35514]: pgmap v315: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 13 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 3.1 KiB/s rd, 198 B/s wr, 5 op/s 2024-09-10T07:59:18.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:18 smithi159 ceph-mon[35522]: pgmap v315: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 13 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 3.1 KiB/s rd, 198 B/s wr, 5 op/s 2024-09-10T07:59:18.614 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T07:59:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 213, 2024-09-10T07:59:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 201, 2024-09-10T07:59:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1442608, 2024-09-10T07:59:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 122592, 2024-09-10T07:59:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.038597863, 2024-09-10T07:59:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.013268560, 2024-09-10T07:59:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.036562158, 2024-09-10T07:59:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 201, 2024-09-10T07:59:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.016043061, 2024-09-10T07:59:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000079816 2024-09-10T07:59:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:18.617 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:18.617 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:18.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.617 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 1442608, 2024-09-10T07:59:18.617 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 122592 2024-09-10T07:59:18.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.617 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:18.617 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 2, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 152, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 320, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 183888, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.012700252, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.008100951, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.002368368, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:18.619 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 149, 2024-09-10T07:59:18.619 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.012455274, 2024-09-10T07:59:18.619 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000083592 2024-09-10T07:59:18.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.619 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:18.619 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:18.619 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:18.620 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:18.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.620 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T07:59:18.620 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 183888 2024-09-10T07:59:18.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.620 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:18.620 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 0, 2024-09-10T07:59:18.620 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2, 2024-09-10T07:59:18.621 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 0, 2024-09-10T07:59:18.621 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 0, 2024-09-10T07:59:18.621 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:18.621 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:18.621 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.000286480, 2024-09-10T07:59:18.621 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T07:59:18.621 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.000215688, 2024-09-10T07:59:18.621 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:18.622 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:18.622 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:18.622 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:18.622 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:18.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.622 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:18.622 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:18.622 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:18.622 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:18.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.623 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T07:59:18.623 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T07:59:18.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.623 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-10T07:59:18.623 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2024-09-10T07:59:18.623 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-10T07:59:18.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.623 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 149034, 2024-09-10T07:59:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 32, 2024-09-10T07:59:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-10T07:59:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-10T07:59:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2024-09-10T07:59:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-10T07:59:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2024-09-10T07:59:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-10T07:59:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-10T07:59:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-10T07:59:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-10T07:59:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-10T07:59:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 211, 2024-09-10T07:59:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 1410165, 2024-09-10T07:59:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 211, 2024-09-10T07:59:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-10T07:59:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-10T07:59:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 211, 2024-09-10T07:59:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1410165, 2024-09-10T07:59:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-10T07:59:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:18.632 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T07:59:19.353 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:19 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:59:19.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:19 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:59:19.390 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-10T07:59:19.391 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-10T07:59:19.391 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-10T07:59:19.391 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-10T07:59:19.391 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T07:59:19.391 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T07:59:19.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:19 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:59:20.213 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:20.337 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:20 smithi073 ceph-mon[30850]: pgmap v316: 97 pgs: 97 active+clean; 13 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-10T07:59:20.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:20 smithi102 ceph-mon[35514]: pgmap v316: 97 pgs: 97 active+clean; 13 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-10T07:59:20.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:20 smithi159 ceph-mon[35522]: pgmap v316: 97 pgs: 97 active+clean; 13 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-10T07:59:20.733 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T07:59:20.733 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:20.733 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 0, 2024-09-10T07:59:20.733 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2, 2024-09-10T07:59:20.733 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 0, 2024-09-10T07:59:20.733 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 0, 2024-09-10T07:59:20.734 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:20.734 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:20.734 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.001570494, 2024-09-10T07:59:20.734 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T07:59:20.734 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.000363079, 2024-09-10T07:59:20.734 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:20.734 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:20.734 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:20.735 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:20.735 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:20.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.735 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:20.735 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:20.735 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:20.735 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:20.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.736 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T07:59:20.736 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T07:59:20.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.736 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:20.736 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 210, 2024-09-10T07:59:20.736 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 198, 2024-09-10T07:59:20.736 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1441792, 2024-09-10T07:59:20.736 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 120672, 2024-09-10T07:59:20.737 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:20.737 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:20.737 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.036738433, 2024-09-10T07:59:20.737 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.012593055, 2024-09-10T07:59:20.737 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.035922789, 2024-09-10T07:59:20.737 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:20.737 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:20.737 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 198, 2024-09-10T07:59:20.738 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.013935283, 2024-09-10T07:59:20.738 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000070380 2024-09-10T07:59:20.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.738 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:20.738 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:20.738 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:20.738 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:20.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.739 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 1441792, 2024-09-10T07:59:20.739 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 120672 2024-09-10T07:59:20.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.739 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:20.739 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 2, 2024-09-10T07:59:20.739 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 150, 2024-09-10T07:59:20.739 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 320, 2024-09-10T07:59:20.740 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 183536, 2024-09-10T07:59:20.740 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:20.740 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:20.740 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.012698480, 2024-09-10T07:59:20.740 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.007737942, 2024-09-10T07:59:20.740 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.002272389, 2024-09-10T07:59:20.740 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:20.740 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:20.740 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 147, 2024-09-10T07:59:20.741 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.010367219, 2024-09-10T07:59:20.741 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000070525 2024-09-10T07:59:20.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.741 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:20.741 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:20.741 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:20.741 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:20.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.741 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T07:59:20.742 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 183536 2024-09-10T07:59:20.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.742 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-10T07:59:20.742 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2024-09-10T07:59:20.742 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-10T07:59:20.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.742 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-10T07:59:20.742 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:20.744 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:20.744 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:20.744 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:20.744 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:20.744 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:20.745 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:20.745 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:20.745 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:20.745 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:20.745 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:20.745 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:20.745 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:20.745 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:20.746 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:20.746 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:20.746 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:20.746 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:20.746 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:20.746 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:20.746 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:20.746 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:20.747 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-10T07:59:20.747 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:20.747 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:20.747 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:20.747 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:20.747 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 148977, 2024-09-10T07:59:20.747 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 30, 2024-09-10T07:59:20.747 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:20.748 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:20.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-10T07:59:20.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-10T07:59:20.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:20.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:20.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:20.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:20.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:20.749 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2024-09-10T07:59:20.749 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:20.749 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:20.749 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:20.749 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-10T07:59:20.749 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:20.749 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2024-09-10T07:59:20.749 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-10T07:59:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-10T07:59:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-10T07:59:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-10T07:59:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-10T07:59:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 208, 2024-09-10T07:59:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 1409775, 2024-09-10T07:59:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 208, 2024-09-10T07:59:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-10T07:59:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-10T07:59:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 208, 2024-09-10T07:59:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1409775, 2024-09-10T07:59:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-10T07:59:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:20.752 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T07:59:21.407 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-10T07:59:21.408 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-10T07:59:21.408 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-10T07:59:21.408 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-10T07:59:21.408 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T07:59:21.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T07:59:21.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T07:59:21.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-10T07:59:21.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: Unable to set osd_memory_target on smithi159 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-10T07:59:21.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-10T07:59:21.628 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:21 smithi102 ceph-mon[35514]: Unable to set osd_memory_target on smithi102 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-10T07:59:21.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T07:59:21.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-10T07:59:21.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: Unable to set osd_memory_target on smithi159 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-10T07:59:21.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-10T07:59:21.659 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:21 smithi159 ceph-mon[35522]: Unable to set osd_memory_target on smithi102 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-10T07:59:21.691 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:21.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T07:59:21.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:21.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-10T07:59:21.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: Unable to set osd_memory_target on smithi159 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-10T07:59:21.723 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:21.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-10T07:59:21.724 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:21 smithi073 ceph-mon[30850]: Unable to set osd_memory_target on smithi102 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-10T07:59:22.187 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-10T07:59:22.187 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:22.187 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 211, 2024-09-10T07:59:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 201, 2024-09-10T07:59:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1440160, 2024-09-10T07:59:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 123424, 2024-09-10T07:59:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.039377273, 2024-09-10T07:59:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.013358103, 2024-09-10T07:59:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.036924229, 2024-09-10T07:59:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 200, 2024-09-10T07:59:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.013222763, 2024-09-10T07:59:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000066113 2024-09-10T07:59:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 1440160, 2024-09-10T07:59:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 123424 2024-09-10T07:59:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 6, 2024-09-10T07:59:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 156, 2024-09-10T07:59:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 3312, 2024-09-10T07:59:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 184688, 2024-09-10T07:59:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.013506645, 2024-09-10T07:59:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.007931588, 2024-09-10T07:59:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.003726429, 2024-09-10T07:59:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 154, 2024-09-10T07:59:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.019374394, 2024-09-10T07:59:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000125807 2024-09-10T07:59:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T07:59:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 184688 2024-09-10T07:59:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 0, 2024-09-10T07:59:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2, 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 0, 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 0, 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.000379742, 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.000298964, 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T07:59:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T07:59:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-10T07:59:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2024-09-10T07:59:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-10T07:59:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-10T07:59:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-10T07:59:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 150008, 2024-09-10T07:59:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 31, 2024-09-10T07:59:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-10T07:59:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-10T07:59:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2024-09-10T07:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-10T07:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2024-09-10T07:59:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-10T07:59:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-10T07:59:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-10T07:59:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-10T07:59:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-10T07:59:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-10T07:59:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 213, 2024-09-10T07:59:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 1410425, 2024-09-10T07:59:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 213, 2024-09-10T07:59:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-10T07:59:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-10T07:59:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 213, 2024-09-10T07:59:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1410425, 2024-09-10T07:59:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-10T07:59:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-10T07:59:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-10T07:59:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-10T07:59:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-10T07:59:22.205 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-10T07:59:22.814 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:22.815 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:22.815 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: pgmap v318: 97 pgs: 97 active+clean; 13 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-10T07:59:22.815 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:22.815 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:22.815 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:22.815 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:22.815 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:59:22.816 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:59:22.816 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:22 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:22.841 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-10T07:59:22.842 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-10T07:59:22.842 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-10T07:59:22.842 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-10T07:59:22.842 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T07:59:22.842 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T07:59:22.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:22.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:22.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: pgmap v318: 97 pgs: 97 active+clean; 13 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-10T07:59:22.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:22.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:22.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:22.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:22.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:59:22.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:59:22.908 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:22 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:23.097 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:59:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: pgmap v318: 97 pgs: 97 active+clean; 13 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-10T07:59:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:23.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T07:59:23.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:59:23.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T07:59:23.127 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:22 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' 2024-09-10T07:59:23.599 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-10T07:59:23.600 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:23.600 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 26154, 2024-09-10T07:59:23.600 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 29235, 2024-09-10T07:59:23.600 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 9035794, 2024-09-10T07:59:23.600 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 38070579, 2024-09-10T07:59:23.600 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 14, 2024-09-10T07:59:23.600 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-10T07:59:23.600 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 1.595135504, 2024-09-10T07:59:23.601 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.567634054, 2024-09-10T07:59:23.601 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 1.974590981, 2024-09-10T07:59:23.601 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.143877353, 2024-09-10T07:59:23.601 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:23.601 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 29234, 2024-09-10T07:59:23.601 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 16.919269047, 2024-09-10T07:59:23.601 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000578753 2024-09-10T07:59:23.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.601 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 40318, 2024-09-10T07:59:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.007461621, 2024-09-10T07:59:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000185 2024-09-10T07:59:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 300016, 2024-09-10T07:59:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 87984 2024-09-10T07:59:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1361, 2024-09-10T07:59:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 1264, 2024-09-10T07:59:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1810510, 2024-09-10T07:59:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 19443254, 2024-09-10T07:59:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 7, 2024-09-10T07:59:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-10T07:59:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.215512008, 2024-09-10T07:59:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.101583301, 2024-09-10T07:59:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.063847391, 2024-09-10T07:59:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.053428000, 2024-09-10T07:59:23.604 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:23.604 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1263, 2024-09-10T07:59:23.604 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.247752832, 2024-09-10T07:59:23.604 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000196162 2024-09-10T07:59:23.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.604 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:23.604 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 104, 2024-09-10T07:59:23.604 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000016393, 2024-09-10T07:59:23.604 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000157 2024-09-10T07:59:23.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.605 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1511760, 2024-09-10T07:59:23.605 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 131632 2024-09-10T07:59:23.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.605 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:23.605 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1070, 2024-09-10T07:59:23.605 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 1064, 2024-09-10T07:59:23.605 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 317780, 2024-09-10T07:59:23.606 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 2534073, 2024-09-10T07:59:23.606 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 11, 2024-09-10T07:59:23.606 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-10T07:59:23.606 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.138629620, 2024-09-10T07:59:23.606 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.061432132, 2024-09-10T07:59:23.606 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.030703655, 2024-09-10T07:59:23.606 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.040174956, 2024-09-10T07:59:23.606 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:23.606 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1060, 2024-09-10T07:59:23.607 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.858129244, 2024-09-10T07:59:23.607 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000809555 2024-09-10T07:59:23.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.607 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:23.607 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 288, 2024-09-10T07:59:23.607 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000045454, 2024-09-10T07:59:23.607 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000157 2024-09-10T07:59:23.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.608 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 96720, 2024-09-10T07:59:23.608 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 465072 2024-09-10T07:59:23.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.608 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-10T07:59:23.608 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-10T07:59:23.608 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-10T07:59:23.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.608 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-10T07:59:23.608 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-10T07:59:23.609 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-10T07:59:23.609 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 4283, 2024-09-10T07:59:23.609 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 11.295218126, 2024-09-10T07:59:23.609 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002637221 2024-09-10T07:59:23.609 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:23.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.609 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-10T07:59:23.609 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-10T07:59:23.610 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-10T07:59:23.610 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 556, 2024-09-10T07:59:23.610 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.049558163, 2024-09-10T07:59:23.610 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000089133 2024-09-10T07:59:23.610 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:23.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.611 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-10T07:59:23.611 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 2035, 2024-09-10T07:59:23.611 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 2035, 2024-09-10T07:59:23.611 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-10T07:59:23.611 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2035, 2024-09-10T07:59:23.611 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 19.219512217, 2024-09-10T07:59:23.611 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.009444477 2024-09-10T07:59:23.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.612 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-10T07:59:23.612 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 0, 2024-09-10T07:59:23.612 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-10T07:59:23.612 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-10T07:59:23.612 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 37, 2024-09-10T07:59:23.612 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 3, 2024-09-10T07:59:23.612 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-10T07:59:23.612 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 1178, 2024-09-10T07:59:23.612 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 74, 2024-09-10T07:59:23.613 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 1104, 2024-09-10T07:59:23.613 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 0, 2024-09-10T07:59:23.613 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 991, 2024-09-10T07:59:23.613 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 0, 2024-09-10T07:59:23.613 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 407, 2024-09-10T07:59:23.613 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 408, 2024-09-10T07:59:23.613 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 2, 2024-09-10T07:59:23.613 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 2610, 2024-09-10T07:59:23.613 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 2494, 2024-09-10T07:59:23.614 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 0, 2024-09-10T07:59:23.614 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 0, 2024-09-10T07:59:23.614 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-10T07:59:23.614 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-10T07:59:23.614 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 49, 2024-09-10T07:59:23.614 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-09-10T07:59:23.614 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-10T07:59:23.614 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 0, 2024-09-10T07:59:23.614 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 0, 2024-09-10T07:59:23.615 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 0, 2024-09-10T07:59:23.615 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 0, 2024-09-10T07:59:23.615 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-10T07:59:23.615 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-09-10T07:59:23.615 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-10T07:59:23.615 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 325, 2024-09-10T07:59:23.615 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 13424230450, 2024-09-10T07:59:23.615 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 6, 2024-09-10T07:59:23.615 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T07:59:23.616 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-10T07:59:23.616 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T07:59:23.616 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-10T07:59:23.616 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-09-10T07:59:23.616 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T07:59:23.616 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T07:59:23.616 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-09-10T07:59:23.616 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-09-10T07:59:23.616 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 576, 2024-09-10T07:59:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 3847, 2024-09-10T07:59:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 6, 2024-09-10T07:59:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T07:59:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T07:59:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 21149, 2024-09-10T07:59:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 19460, 2024-09-10T07:59:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 33, 2024-09-10T07:59:23.618 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 916 2024-09-10T07:59:23.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.618 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-10T07:59:23.618 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-10T07:59:23.618 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-10T07:59:23.618 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-10T07:59:23.618 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 0, 2024-09-10T07:59:23.618 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 0, 2024-09-10T07:59:23.619 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-10T07:59:23.619 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-10T07:59:23.619 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-10T07:59:23.619 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 530, 2024-09-10T07:59:23.619 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 469, 2024-09-10T07:59:23.619 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 61, 2024-09-10T07:59:23.619 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-10T07:59:23.619 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-10T07:59:23.619 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-10T07:59:23.620 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-10T07:59:23.620 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-10T07:59:23.620 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-10T07:59:23.620 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 0, 2024-09-10T07:59:23.620 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 0, 2024-09-10T07:59:23.620 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T07:59:23.620 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 0, 2024-09-10T07:59:23.620 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-10T07:59:23.621 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 3, 2024-09-10T07:59:23.621 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-10T07:59:23.621 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-10T07:59:23.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.621 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-10T07:59:23.621 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-10T07:59:23.621 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 22672, 2024-09-10T07:59:23.621 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-10T07:59:23.622 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-10T07:59:23.622 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 22672, 2024-09-10T07:59:23.622 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-10T07:59:23.622 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-10T07:59:23.622 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 30, 2024-09-10T07:59:23.622 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-10T07:59:23.622 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-10T07:59:23.622 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 30, 2024-09-10T07:59:23.623 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 3, 2024-09-10T07:59:23.623 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-10T07:59:23.623 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-10T07:59:23.623 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-10T07:59:23.623 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 64521632, 2024-09-10T07:59:23.623 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 0, 2024-09-10T07:59:23.623 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-10T07:59:23.623 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2430, 2024-09-10T07:59:23.623 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 179.195798320, 2024-09-10T07:59:23.624 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.073743126 2024-09-10T07:59:23.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.624 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 0 2024-09-10T07:59:23.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.624 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-10T07:59:23.624 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 953, 2024-09-10T07:59:23.624 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 1422, 2024-09-10T07:59:23.624 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 469, 2024-09-10T07:59:23.625 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 122, 2024-09-10T07:59:23.625 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 141, 2024-09-10T07:59:23.625 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 19, 2024-09-10T07:59:23.625 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 1178, 2024-09-10T07:59:23.625 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 1705, 2024-09-10T07:59:23.625 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 527, 2024-09-10T07:59:23.625 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 408, 2024-09-10T07:59:23.625 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 892, 2024-09-10T07:59:23.625 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 484, 2024-09-10T07:59:23.626 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 78216, 2024-09-10T07:59:23.626 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 231712 2024-09-10T07:59:23.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.626 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-10T07:59:23.626 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 2384, 2024-09-10T07:59:23.626 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 0, 2024-09-10T07:59:23.626 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 2035, 2024-09-10T07:59:23.626 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 29, 2024-09-10T07:59:23.627 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 0, 2024-09-10T07:59:23.627 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-10T07:59:23.627 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 765, 2024-09-10T07:59:23.627 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.762393719, 2024-09-10T07:59:23.627 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000996593 2024-09-10T07:59:23.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.627 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-10T07:59:23.627 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 167, 2024-09-10T07:59:23.627 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.840872606, 2024-09-10T07:59:23.628 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.011023189 2024-09-10T07:59:23.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.628 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-10T07:59:23.628 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.628 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.629 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.629 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-10T07:59:23.629 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 61, 2024-09-10T07:59:23.629 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.046621729, 2024-09-10T07:59:23.629 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000764290 2024-09-10T07:59:23.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.629 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-10T07:59:23.629 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 61, 2024-09-10T07:59:23.630 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.017310199, 2024-09-10T07:59:23.630 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000283773 2024-09-10T07:59:23.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.630 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-10T07:59:23.630 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.630 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.630 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.630 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-10T07:59:23.631 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-09-10T07:59:23.631 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000234085, 2024-09-10T07:59:23.631 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000117042 2024-09-10T07:59:23.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.631 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-10T07:59:23.631 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.631 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.631 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.632 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-10T07:59:23.632 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.632 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.632 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.632 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-10T07:59:23.632 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.632 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.633 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.633 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-10T07:59:23.633 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 10, 2024-09-10T07:59:23.633 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.003802936, 2024-09-10T07:59:23.633 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000380293 2024-09-10T07:59:23.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.633 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-10T07:59:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 105, 2024-09-10T07:59:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.094675812, 2024-09-10T07:59:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000901674 2024-09-10T07:59:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-10T07:59:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.635 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-10T07:59:23.635 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 10, 2024-09-10T07:59:23.635 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2.993953555, 2024-09-10T07:59:23.635 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.299395355 2024-09-10T07:59:23.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.635 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-10T07:59:23.635 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 49, 2024-09-10T07:59:23.635 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.009369021, 2024-09-10T07:59:23.635 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000191204 2024-09-10T07:59:23.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.636 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-10T07:59:23.636 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 160, 2024-09-10T07:59:23.636 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.859778234, 2024-09-10T07:59:23.636 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.005373613 2024-09-10T07:59:23.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.636 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-10T07:59:23.636 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 113, 2024-09-10T07:59:23.637 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 11.743450867, 2024-09-10T07:59:23.637 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.103924343 2024-09-10T07:59:23.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.637 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-10T07:59:23.637 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.638 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.638 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.638 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-10T07:59:23.638 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.638 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.638 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.639 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-10T07:59:23.639 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 16, 2024-09-10T07:59:23.639 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.132886740, 2024-09-10T07:59:23.639 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.008305421 2024-09-10T07:59:23.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.639 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-10T07:59:23.639 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 4, 2024-09-10T07:59:23.639 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.020216416, 2024-09-10T07:59:23.640 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.005054104 2024-09-10T07:59:23.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.640 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-10T07:59:23.640 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.640 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.640 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.640 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-10T07:59:23.640 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 7, 2024-09-10T07:59:23.641 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.029165062, 2024-09-10T07:59:23.641 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.004166437 2024-09-10T07:59:23.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.641 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-10T07:59:23.641 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.641 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.641 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.642 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-10T07:59:23.642 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 4, 2024-09-10T07:59:23.642 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.001160617, 2024-09-10T07:59:23.642 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000290154 2024-09-10T07:59:23.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.642 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-10T07:59:23.642 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.642 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.642 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.643 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-10T07:59:23.643 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 7, 2024-09-10T07:59:23.643 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.018556978, 2024-09-10T07:59:23.643 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002650996 2024-09-10T07:59:23.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.643 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-10T07:59:23.643 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 13, 2024-09-10T07:59:23.644 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.007522769, 2024-09-10T07:59:23.644 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000578674 2024-09-10T07:59:23.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.644 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-10T07:59:23.644 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 481, 2024-09-10T07:59:23.644 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.637540872, 2024-09-10T07:59:23.644 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001325448 2024-09-10T07:59:23.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.645 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-10T07:59:23.645 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-10T07:59:23.645 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-10T07:59:23.645 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.645 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.645 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.645 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:23.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.646 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-10T07:59:23.646 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 2, 2024-09-10T07:59:23.646 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 5, 2024-09-10T07:59:23.646 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 3, 2024-09-10T07:59:23.646 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 2, 2024-09-10T07:59:23.646 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-10T07:59:23.646 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 31, 2024-09-10T07:59:23.647 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 15, 2024-09-10T07:59:23.647 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 589, 2024-09-10T07:59:23.647 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-10T07:59:23.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.647 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-10T07:59:23.647 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:23.647 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:23.647 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:23.647 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:23.648 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:23.648 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:23.648 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:23.648 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:23.648 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:23.648 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:23.648 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:23.648 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:23.649 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:23.649 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:23.649 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:23.649 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:23.649 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:23.649 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:23.649 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:23.649 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:23.649 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:23.650 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:23.650 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:23.650 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:23.650 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:23.650 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:23.650 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:23.650 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:23.650 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:23.650 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:23.651 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:23.651 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-10T07:59:23.651 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:23.651 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:23.651 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:23.651 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:23.651 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 341480, 2024-09-10T07:59:23.651 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 533, 2024-09-10T07:59:23.652 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 968, 2024-09-10T07:59:23.652 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 11, 2024-09-10T07:59:23.652 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-10T07:59:23.652 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-10T07:59:23.652 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:23.652 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:23.652 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:23.652 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:23.652 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 8576, 2024-09-10T07:59:23.653 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 188, 2024-09-10T07:59:23.653 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:23.653 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:23.653 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:23.653 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-10T07:59:23.653 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 3393025, 2024-09-10T07:59:23.653 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 36225, 2024-09-10T07:59:23.653 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:23.653 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-10T07:59:23.654 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:23.654 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-10T07:59:23.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.654 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-10T07:59:23.654 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-10T07:59:23.654 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-10T07:59:23.654 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 3742, 2024-09-10T07:59:23.654 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 60783957, 2024-09-10T07:59:23.654 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 32, 2024-09-10T07:59:23.655 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 3742, 2024-09-10T07:59:23.655 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-10T07:59:23.655 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3742, 2024-09-10T07:59:23.655 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 204.642854584, 2024-09-10T07:59:23.655 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.054688095 2024-09-10T07:59:23.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.655 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-10T07:59:23.655 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-10T07:59:23.655 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3742, 2024-09-10T07:59:23.656 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 4018 2024-09-10T07:59:23.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.656 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 3742, 2024-09-10T07:59:23.656 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 11, 2024-09-10T07:59:23.656 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 3731, 2024-09-10T07:59:23.656 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-10T07:59:23.656 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-10T07:59:23.656 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2024-09-10T07:59:23.656 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 11, 2024-09-10T07:59:23.657 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 11, 2024-09-10T07:59:23.657 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 2441, 2024-09-10T07:59:23.657 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 41, 2024-09-10T07:59:23.657 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-10T07:59:23.657 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-10T07:59:23.657 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-10T07:59:23.657 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 1, 2024-09-10T07:59:23.657 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 997, 2024-09-10T07:59:23.657 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-10T07:59:23.658 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-10T07:59:23.658 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-10T07:59:23.658 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2024-09-10T07:59:23.658 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 22, 2024-09-10T07:59:23.658 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-10T07:59:23.658 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-10T07:59:23.658 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-10T07:59:23.658 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-10T07:59:23.659 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-10T07:59:23.659 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-10T07:59:23.659 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T07:59:23.659 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-10T07:59:23.659 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-10T07:59:23.659 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 6, 2024-09-10T07:59:23.659 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-10T07:59:23.659 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-10T07:59:23.660 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-10T07:59:23.660 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-10T07:59:23.660 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-10T07:59:23.660 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-10T07:59:23.660 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-10T07:59:23.660 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-10T07:59:23.660 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-10T07:59:23.660 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-10T07:59:23.661 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-10T07:59:23.661 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-10T07:59:23.661 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-10T07:59:23.661 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-10T07:59:23.661 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-10T07:59:23.661 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-10T07:59:23.661 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 94, 2024-09-10T07:59:23.661 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-10T07:59:23.662 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 13, 2024-09-10T07:59:23.662 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 12, 2024-09-10T07:59:23.662 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 12, 2024-09-10T07:59:23.662 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-10T07:59:23.662 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-10T07:59:23.662 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 363, 2024-09-10T07:59:23.662 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2024-09-10T07:59:23.662 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 125 2024-09-10T07:59:23.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.663 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-10T07:59:23.663 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 1, 2024-09-10T07:59:23.663 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-10T07:59:23.663 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-10T07:59:23.663 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-10T07:59:23.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.664 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-10T07:59:23.664 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 1 2024-09-10T07:59:23.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.664 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-10T07:59:23.664 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-10T07:59:23.664 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 32, 2024-09-10T07:59:23.664 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-10T07:59:23.664 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 32, 2024-09-10T07:59:23.665 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 469, 2024-09-10T07:59:23.665 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 469, 2024-09-10T07:59:23.665 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-10T07:59:23.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.665 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:23.665 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:23.665 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-10T07:59:23.665 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:23.666 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 28581, 2024-09-10T07:59:23.666 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 8529904, 2024-09-10T07:59:23.666 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:23.666 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 28581, 2024-09-10T07:59:23.666 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-10T07:59:23.666 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-10T07:59:23.666 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 28581, 2024-09-10T07:59:23.666 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 8529904, 2024-09-10T07:59:23.667 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:23.667 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.667 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.667 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.667 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:23.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.667 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-10T07:59:23.667 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:23.667 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-10T07:59:23.668 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:23.668 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-10T07:59:23.668 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-10T07:59:23.668 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:23.668 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-10T07:59:23.668 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 3742, 2024-09-10T07:59:23.668 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 60831326, 2024-09-10T07:59:23.669 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 3742, 2024-09-10T07:59:23.669 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 60831326, 2024-09-10T07:59:23.669 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:23.669 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.669 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.669 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.669 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:23.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.669 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-10T07:59:23.670 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:23.670 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-10T07:59:23.670 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:23.670 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-10T07:59:23.670 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-10T07:59:23.670 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:23.670 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-10T07:59:23.670 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 3742, 2024-09-10T07:59:23.671 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 3742, 2024-09-10T07:59:23.671 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 3742, 2024-09-10T07:59:23.671 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 3742, 2024-09-10T07:59:23.671 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:23.671 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.671 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.671 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.671 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:23.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.672 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-10T07:59:23.672 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:23.672 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-10T07:59:23.672 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:23.672 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 469, 2024-09-10T07:59:23.672 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 47369, 2024-09-10T07:59:23.672 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:23.672 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 469, 2024-09-10T07:59:23.673 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-10T07:59:23.673 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-10T07:59:23.673 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 11, 2024-09-10T07:59:23.673 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 47369, 2024-09-10T07:59:23.673 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:23.673 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.674 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.674 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.674 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:23.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:23.674 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x558c00f56960": { 2024-09-10T07:59:23.674 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:23.674 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-10T07:59:23.674 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:23.675 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 22672, 2024-09-10T07:59:23.675 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 60327328, 2024-09-10T07:59:23.675 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:23.675 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 22672, 2024-09-10T07:59:23.675 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-10T07:59:23.675 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-10T07:59:23.675 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2430, 2024-09-10T07:59:23.675 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 60327328, 2024-09-10T07:59:23.675 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:23.676 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:23.676 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:23.676 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:23.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:23.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:23.676 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-10T07:59:23.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:23 smithi102 ceph-mon[35514]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-10T07:59:23.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:23 smithi102 ceph-mon[35514]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-10T07:59:23.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:23 smithi073 ceph-mon[30850]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-10T07:59:23.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:23 smithi073 ceph-mon[30850]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-10T07:59:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:23 smithi159 ceph-mon[35522]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-10T07:59:24.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:23 smithi159 ceph-mon[35522]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-10T07:59:24.665 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-10T07:59:24.666 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-10T07:59:24.666 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-10T07:59:24.666 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=3 2024-09-10T07:59:24.666 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T07:59:24.666 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T07:59:24.919 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:59:24.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:24 smithi073 ceph-mon[30850]: pgmap v319: 97 pgs: 97 active+clean; 13 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:59:25.040 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:24 smithi102 ceph-mon[35514]: pgmap v319: 97 pgs: 97 active+clean; 13 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:59:25.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:24 smithi159 ceph-mon[35522]: pgmap v319: 97 pgs: 97 active+clean; 13 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:59:25.548 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-10T07:59:25.548 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:25.548 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 0, 2024-09-10T07:59:25.548 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 2, 2024-09-10T07:59:25.548 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 0, 2024-09-10T07:59:25.548 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 0, 2024-09-10T07:59:25.549 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:25.549 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:25.549 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.001074087, 2024-09-10T07:59:25.549 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T07:59:25.549 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.000217485, 2024-09-10T07:59:25.549 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:25.549 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:25.549 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:25.549 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:25.550 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:25.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.550 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:25.550 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:25.550 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:25.550 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:25.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.550 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T07:59:25.551 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T07:59:25.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.551 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:25.551 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 6, 2024-09-10T07:59:25.551 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 155, 2024-09-10T07:59:25.551 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3312, 2024-09-10T07:59:25.551 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 184512, 2024-09-10T07:59:25.551 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:25.551 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:25.552 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.011941691, 2024-09-10T07:59:25.552 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.006779909, 2024-09-10T07:59:25.552 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.003441095, 2024-09-10T07:59:25.552 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:25.552 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:25.552 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 153, 2024-09-10T07:59:25.552 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.014435159, 2024-09-10T07:59:25.552 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000094347 2024-09-10T07:59:25.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.553 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:25.553 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:25.553 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:25.553 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:25.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.553 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T07:59:25.553 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 184512 2024-09-10T07:59:25.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.553 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 210, 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 200, 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1439888, 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 122784, 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.035682997, 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.012401535, 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.036726328, 2024-09-10T07:59:25.554 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:25.555 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:25.555 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 199, 2024-09-10T07:59:25.555 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.010747131, 2024-09-10T07:59:25.555 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000054005 2024-09-10T07:59:25.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.555 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:25.555 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:25.555 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:25.555 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:25.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.556 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1439888, 2024-09-10T07:59:25.556 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 122784 2024-09-10T07:59:25.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.556 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-10T07:59:25.556 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 0, 2024-09-10T07:59:25.556 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-10T07:59:25.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.556 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-10T07:59:25.557 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:25.557 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:25.557 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:25.557 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:25.557 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:25.557 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:25.557 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:25.557 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:25.557 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:25.558 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:25.558 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:25.558 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:25.558 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:25.558 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:25.558 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:25.558 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:25.558 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:25.558 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:25.559 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:25.559 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:25.559 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:25.559 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:25.559 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:25.559 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:25.559 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:25.559 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:25.560 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:25.560 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:25.560 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:25.560 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:25.560 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:25.560 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-10T07:59:25.560 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:25.561 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:25.561 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:25.561 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:25.561 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 148967, 2024-09-10T07:59:25.561 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 29, 2024-09-10T07:59:25.561 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-10T07:59:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-10T07:59:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 0, 2024-09-10T07:59:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-10T07:59:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 2, 2024-09-10T07:59:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-10T07:59:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-10T07:59:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-10T07:59:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 212, 2024-09-10T07:59:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 1410295, 2024-09-10T07:59:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 212, 2024-09-10T07:59:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-10T07:59:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-10T07:59:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 212, 2024-09-10T07:59:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 1410295, 2024-09-10T07:59:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:25.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:25.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:25.567 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-10T07:59:26.233 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-10T07:59:26.233 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-10T07:59:26.233 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-10T07:59:26.233 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-10T07:59:26.233 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T07:59:26.233 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T07:59:26.306 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:26 smithi102 ceph-mon[35514]: pgmap v320: 97 pgs: 97 active+clean; 13 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:59:26.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:26 smithi159 ceph-mon[35522]: pgmap v320: 97 pgs: 97 active+clean; 13 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:59:26.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:26 smithi073 ceph-mon[30850]: pgmap v320: 97 pgs: 97 active+clean; 13 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-10T07:59:26.484 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:59:27.026 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-10T07:59:27.026 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:27.026 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1100, 2024-09-10T07:59:27.027 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 1089, 2024-09-10T07:59:27.027 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 14326620, 2024-09-10T07:59:27.027 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 402084, 2024-09-10T07:59:27.027 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 6, 2024-09-10T07:59:27.027 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-09-10T07:59:27.027 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.130203943, 2024-09-10T07:59:27.027 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.044741989, 2024-09-10T07:59:27.027 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.066974965, 2024-09-10T07:59:27.028 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.024624109, 2024-09-10T07:59:27.028 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:27.028 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1088, 2024-09-10T07:59:27.028 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.063630662, 2024-09-10T07:59:27.028 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000058484 2024-09-10T07:59:27.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.028 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:27.029 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.029 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.029 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.029 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1460144, 2024-09-10T07:59:27.029 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 124784 2024-09-10T07:59:27.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.029 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 305, 2024-09-10T07:59:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 453, 2024-09-10T07:59:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 25247852, 2024-09-10T07:59:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 525900, 2024-09-10T07:59:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 8, 2024-09-10T07:59:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 6, 2024-09-10T07:59:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.052549715, 2024-09-10T07:59:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.012419359, 2024-09-10T07:59:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.026076740, 2024-09-10T07:59:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.010692672, 2024-09-10T07:59:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 451, 2024-09-10T07:59:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.035188490, 2024-09-10T07:59:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000078023 2024-09-10T07:59:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T07:59:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 430752 2024-09-10T07:59:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 994, 2024-09-10T07:59:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 996, 2024-09-10T07:59:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 22896529, 2024-09-10T07:59:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 316099, 2024-09-10T07:59:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 6, 2024-09-10T07:59:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-10T07:59:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.085859559, 2024-09-10T07:59:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.019118003, 2024-09-10T07:59:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.035348419, 2024-09-10T07:59:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.026035168, 2024-09-10T07:59:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 994, 2024-09-10T07:59:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.059638489, 2024-09-10T07:59:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000059998 2024-09-10T07:59:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T07:59:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T07:59:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-10T07:59:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-10T07:59:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-10T07:59:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-10T07:59:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-10T07:59:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-10T07:59:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3623, 2024-09-10T07:59:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.080616994, 2024-09-10T07:59:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000022251 2024-09-10T07:59:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-10T07:59:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-10T07:59:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-10T07:59:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-10T07:59:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 0, 2024-09-10T07:59:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 0, 2024-09-10T07:59:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-10T07:59:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-10T07:59:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 0, 2024-09-10T07:59:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-10T07:59:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-10T07:59:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 0, 2024-09-10T07:59:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 0, 2024-09-10T07:59:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-10T07:59:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 1610, 2024-09-10T07:59:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 0, 2024-09-10T07:59:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 1610, 2024-09-10T07:59:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 0, 2024-09-10T07:59:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 1610, 2024-09-10T07:59:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 0, 2024-09-10T07:59:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 0, 2024-09-10T07:59:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 0, 2024-09-10T07:59:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 2, 2024-09-10T07:59:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 0, 2024-09-10T07:59:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 0, 2024-09-10T07:59:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 0, 2024-09-10T07:59:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 0, 2024-09-10T07:59:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-10T07:59:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-10T07:59:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-09-10T07:59:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-09-10T07:59:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-10T07:59:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 0, 2024-09-10T07:59:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 0, 2024-09-10T07:59:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 0, 2024-09-10T07:59:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 0, 2024-09-10T07:59:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-10T07:59:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-09-10T07:59:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-10T07:59:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 325, 2024-09-10T07:59:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 13424230450, 2024-09-10T07:59:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 6, 2024-09-10T07:59:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T07:59:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-10T07:59:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T07:59:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-10T07:59:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-09-10T07:59:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T07:59:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T07:59:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-09-10T07:59:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-09-10T07:59:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T07:59:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 0, 2024-09-10T07:59:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T07:59:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T07:59:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T07:59:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 0, 2024-09-10T07:59:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 0, 2024-09-10T07:59:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 0, 2024-09-10T07:59:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 0 2024-09-10T07:59:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-10T07:59:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-10T07:59:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-10T07:59:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-10T07:59:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 0, 2024-09-10T07:59:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 0, 2024-09-10T07:59:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-10T07:59:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-10T07:59:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-10T07:59:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 0, 2024-09-10T07:59:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 0, 2024-09-10T07:59:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-09-10T07:59:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-10T07:59:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-10T07:59:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-10T07:59:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-10T07:59:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-10T07:59:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-10T07:59:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 0, 2024-09-10T07:59:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 0, 2024-09-10T07:59:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T07:59:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 0, 2024-09-10T07:59:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-10T07:59:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 0, 2024-09-10T07:59:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-10T07:59:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-10T07:59:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-10T07:59:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-10T07:59:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 0, 2024-09-10T07:59:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-10T07:59:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-10T07:59:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 22672, 2024-09-10T07:59:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-10T07:59:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-10T07:59:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 0, 2024-09-10T07:59:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-10T07:59:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-10T07:59:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 30, 2024-09-10T07:59:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 3, 2024-09-10T07:59:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-10T07:59:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-10T07:59:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-10T07:59:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 64521632, 2024-09-10T07:59:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 64521520, 2024-09-10T07:59:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-10T07:59:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 22672 2024-09-10T07:59:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-10T07:59:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 946, 2024-09-10T07:59:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 1415, 2024-09-10T07:59:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 469, 2024-09-10T07:59:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 115, 2024-09-10T07:59:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 134, 2024-09-10T07:59:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 19, 2024-09-10T07:59:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 1610, 2024-09-10T07:59:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 1658, 2024-09-10T07:59:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 48, 2024-09-10T07:59:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 0, 2024-09-10T07:59:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 0, 2024-09-10T07:59:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 0, 2024-09-10T07:59:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 57792, 2024-09-10T07:59:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 215328 2024-09-10T07:59:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-10T07:59:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 0, 2024-09-10T07:59:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 0, 2024-09-10T07:59:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 0, 2024-09-10T07:59:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 0, 2024-09-10T07:59:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 0, 2024-09-10T07:59:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-10T07:59:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-10T07:59:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-10T07:59:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-10T07:59:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-10T07:59:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-10T07:59:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-10T07:59:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-10T07:59:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-10T07:59:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-10T07:59:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-10T07:59:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-10T07:59:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-10T07:59:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-10T07:59:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-10T07:59:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-10T07:59:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-10T07:59:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-10T07:59:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-10T07:59:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-10T07:59:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-10T07:59:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-10T07:59:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-10T07:59:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-10T07:59:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-10T07:59:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-10T07:59:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-10T07:59:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-10T07:59:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-10T07:59:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-10T07:59:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-10T07:59:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-10T07:59:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-10T07:59:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 2, 2024-09-10T07:59:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 5, 2024-09-10T07:59:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 3, 2024-09-10T07:59:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 4, 2024-09-10T07:59:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-10T07:59:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 0, 2024-09-10T07:59:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 0, 2024-09-10T07:59:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 5356, 2024-09-10T07:59:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-10T07:59:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-10T07:59:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-10T07:59:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 262200, 2024-09-10T07:59:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 1096, 2024-09-10T07:59:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-10T07:59:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-10T07:59:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 8576, 2024-09-10T07:59:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 188, 2024-09-10T07:59:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-10T07:59:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 3569524, 2024-09-10T07:59:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 39109, 2024-09-10T07:59:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-10T07:59:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-10T07:59:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-10T07:59:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-10T07:59:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-10T07:59:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 2165, 2024-09-10T07:59:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 26, 2024-09-10T07:59:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 4, 2024-09-10T07:59:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 2165, 2024-09-10T07:59:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-10T07:59:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2165, 2024-09-10T07:59:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 76.248445909, 2024-09-10T07:59:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.035218681 2024-09-10T07:59:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-10T07:59:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-10T07:59:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2165, 2024-09-10T07:59:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2166 2024-09-10T07:59:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 2165, 2024-09-10T07:59:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 2165, 2024-09-10T07:59:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 0, 2024-09-10T07:59:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-10T07:59:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-10T07:59:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 1305, 2024-09-10T07:59:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 0, 2024-09-10T07:59:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 857, 2024-09-10T07:59:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 0, 2024-09-10T07:59:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2024-09-10T07:59:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-10T07:59:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-10T07:59:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-10T07:59:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2024-09-10T07:59:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2024-09-10T07:59:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-10T07:59:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-10T07:59:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-10T07:59:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 2, 2024-09-10T07:59:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 0, 2024-09-10T07:59:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-10T07:59:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-10T07:59:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-10T07:59:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-10T07:59:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-10T07:59:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-10T07:59:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T07:59:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-10T07:59:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-10T07:59:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-09-10T07:59:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-10T07:59:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-10T07:59:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-10T07:59:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-10T07:59:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-10T07:59:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-10T07:59:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-10T07:59:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-10T07:59:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-10T07:59:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-10T07:59:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-10T07:59:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-10T07:59:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-10T07:59:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-10T07:59:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-10T07:59:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-10T07:59:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 94, 2024-09-10T07:59:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-10T07:59:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 13, 2024-09-10T07:59:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 9, 2024-09-10T07:59:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 9, 2024-09-10T07:59:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-10T07:59:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-10T07:59:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2024-09-10T07:59:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 2, 2024-09-10T07:59:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2024-09-10T07:59:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-10T07:59:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 0, 2024-09-10T07:59:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-10T07:59:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-10T07:59:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-10T07:59:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-10T07:59:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-09-10T07:59:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-10T07:59:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-10T07:59:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T07:59:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-10T07:59:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 0, 2024-09-10T07:59:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 0, 2024-09-10T07:59:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 0, 2024-09-10T07:59:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-10T07:59:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-10T07:59:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 2395, 2024-09-10T07:59:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 62240820, 2024-09-10T07:59:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 2395, 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2395, 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 62240820, 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-10T07:59:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-10T07:59:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-10T07:59:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-10T07:59:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-10T07:59:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2165, 2024-09-10T07:59:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 60403947, 2024-09-10T07:59:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2165, 2024-09-10T07:59:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 60403947, 2024-09-10T07:59:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-10T07:59:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-10T07:59:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-10T07:59:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-10T07:59:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-10T07:59:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2165, 2024-09-10T07:59:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 2165, 2024-09-10T07:59:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2165, 2024-09-10T07:59:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2165, 2024-09-10T07:59:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-10T07:59:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-10T07:59:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-10T07:59:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-10T07:59:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-10T07:59:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-10T07:59:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-10T07:59:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-09-10T07:59:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-09-10T07:59:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x55d47c5bab40": { 2024-09-10T07:59:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-10T07:59:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-10T07:59:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-10T07:59:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-10T07:59:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-10T07:59:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-10T07:59:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-09-10T07:59:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-09-10T07:59:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:27.104 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-10T07:59:27.828 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-10T07:59:27.828 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-10T07:59:27.828 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T07:59:27.828 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-10T07:59:27.829 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T07:59:27.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T07:59:28.078 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T07:59:28.126 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:28 smithi102 ceph-mon[35514]: pgmap v321: 97 pgs: 97 active+clean; 13 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:59:28.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:28 smithi159 ceph-mon[35522]: pgmap v321: 97 pgs: 97 active+clean; 13 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:59:28.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:28 smithi073 ceph-mon[30850]: pgmap v321: 97 pgs: 97 active+clean; 13 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:59:28.570 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-10T07:59:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 217, 2024-09-10T07:59:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 205, 2024-09-10T07:59:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1443696, 2024-09-10T07:59:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 125152, 2024-09-10T07:59:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.041100426, 2024-09-10T07:59:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.012580896, 2024-09-10T07:59:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.041403411, 2024-09-10T07:59:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 205, 2024-09-10T07:59:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.014509622, 2024-09-10T07:59:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000070778 2024-09-10T07:59:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1443696, 2024-09-10T07:59:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 125152 2024-09-10T07:59:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 2, 2024-09-10T07:59:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 155, 2024-09-10T07:59:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 320, 2024-09-10T07:59:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 184416, 2024-09-10T07:59:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.009742131, 2024-09-10T07:59:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.005815015, 2024-09-10T07:59:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.002213261, 2024-09-10T07:59:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 152, 2024-09-10T07:59:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.017505076, 2024-09-10T07:59:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000115164 2024-09-10T07:59:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T07:59:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 184416 2024-09-10T07:59:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 0, 2024-09-10T07:59:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 2, 2024-09-10T07:59:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 0, 2024-09-10T07:59:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 0, 2024-09-10T07:59:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.000296587, 2024-09-10T07:59:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T07:59:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.000229656, 2024-09-10T07:59:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T07:59:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T07:59:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-10T07:59:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 0, 2024-09-10T07:59:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-10T07:59:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-10T07:59:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-10T07:59:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 148967, 2024-09-10T07:59:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 29, 2024-09-10T07:59:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-10T07:59:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-10T07:59:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 0, 2024-09-10T07:59:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-10T07:59:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 2, 2024-09-10T07:59:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-10T07:59:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-10T07:59:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-10T07:59:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-10T07:59:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-10T07:59:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-10T07:59:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 215, 2024-09-10T07:59:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 1410685, 2024-09-10T07:59:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 215, 2024-09-10T07:59:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-10T07:59:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-10T07:59:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 215, 2024-09-10T07:59:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 1410685, 2024-09-10T07:59:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-10T07:59:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-10T07:59:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-10T07:59:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-10T07:59:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-10T07:59:28.593 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-10T07:59:29.284 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-10T07:59:29.285 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-10T07:59:29.285 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-10T07:59:29.285 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-10T07:59:29.285 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T07:59:29.285 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T07:59:29.539 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:59:30.051 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T07:59:30.052 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:30.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 210, 2024-09-10T07:59:30.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 200, 2024-09-10T07:59:30.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 1439888, 2024-09-10T07:59:30.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 122784, 2024-09-10T07:59:30.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:30.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:30.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.039868259, 2024-09-10T07:59:30.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.013002687, 2024-09-10T07:59:30.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.040162788, 2024-09-10T07:59:30.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:30.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:30.053 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 199, 2024-09-10T07:59:30.053 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.010930375, 2024-09-10T07:59:30.053 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000054926 2024-09-10T07:59:30.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 1439888, 2024-09-10T07:59:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 122784 2024-09-10T07:59:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.055 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:30.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 2, 2024-09-10T07:59:30.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 153, 2024-09-10T07:59:30.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 320, 2024-09-10T07:59:30.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 184064, 2024-09-10T07:59:30.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:30.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:30.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.009473091, 2024-09-10T07:59:30.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.006154702, 2024-09-10T07:59:30.056 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.001339104, 2024-09-10T07:59:30.056 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:30.056 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:30.056 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 150, 2024-09-10T07:59:30.056 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.015796152, 2024-09-10T07:59:30.056 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000105307 2024-09-10T07:59:30.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.057 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:30.057 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:30.057 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:30.057 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:30.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.057 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T07:59:30.057 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 184064 2024-09-10T07:59:30.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.057 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:30.058 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 4, 2024-09-10T07:59:30.058 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 4, 2024-09-10T07:59:30.058 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 2992, 2024-09-10T07:59:30.058 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 448, 2024-09-10T07:59:30.058 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:30.058 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:30.058 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.002268332, 2024-09-10T07:59:30.058 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.000039108, 2024-09-10T07:59:30.059 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.002222626, 2024-09-10T07:59:30.059 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:30.059 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:30.059 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 3, 2024-09-10T07:59:30.059 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.004115079, 2024-09-10T07:59:30.059 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001371693 2024-09-10T07:59:30.059 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.059 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:30.060 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:30.060 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:30.060 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:30.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.060 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T07:59:30.060 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T07:59:30.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.060 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-10T07:59:30.060 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 0, 2024-09-10T07:59:30.061 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-10T07:59:30.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.061 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-10T07:59:30.061 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:30.061 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:30.061 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:30.061 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:30.061 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:30.062 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:30.062 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:30.062 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:30.062 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:30.062 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:30.062 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:30.062 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:30.062 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:30.063 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:30.063 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:30.063 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:30.063 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:30.063 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:30.063 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:30.063 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:30.063 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:30.064 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:30.064 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:30.064 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:30.064 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:30.064 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:30.064 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:30.064 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:30.064 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:30.064 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:30.065 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:30.065 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-10T07:59:30.065 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:30.065 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:30.065 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:30.065 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:30.065 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 148967, 2024-09-10T07:59:30.065 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 29, 2024-09-10T07:59:30.066 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:30.066 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:30.066 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-10T07:59:30.066 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-10T07:59:30.066 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:30.066 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:30.066 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:30.066 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:30.067 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:30.067 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 0, 2024-09-10T07:59:30.067 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:30.067 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:30.067 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:30.067 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-10T07:59:30.067 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:30.067 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 2, 2024-09-10T07:59:30.068 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:30.068 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-10T07:59:30.068 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:30.068 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-10T07:59:30.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:30.068 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:30.068 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-10T07:59:30.068 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-10T07:59:30.069 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-10T07:59:30.069 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 212, 2024-09-10T07:59:30.069 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 1410295, 2024-09-10T07:59:30.069 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:30.069 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 212, 2024-09-10T07:59:30.069 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-10T07:59:30.069 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-10T07:59:30.069 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 212, 2024-09-10T07:59:30.069 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 1410295, 2024-09-10T07:59:30.070 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-10T07:59:30.070 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:30.070 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:30.070 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:30.070 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T07:59:30.070 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T07:59:30.070 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T07:59:30.341 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:30 smithi159 ceph-mon[35522]: pgmap v322: 97 pgs: 97 active+clean; 13 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:59:30.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:30 smithi102 ceph-mon[35514]: pgmap v322: 97 pgs: 97 active+clean; 13 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:59:30.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:30 smithi073 ceph-mon[30850]: pgmap v322: 97 pgs: 97 active+clean; 13 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-10T07:59:30.858 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-10T07:59:30.858 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-10T07:59:30.858 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-10T07:59:30.858 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.c 2024-09-10T07:59:30.858 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T07:59:30.859 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T07:59:31.124 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:59:31.648 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T07:59:31.648 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:31.648 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 0, 2024-09-10T07:59:31.648 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 2, 2024-09-10T07:59:31.648 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 0, 2024-09-10T07:59:31.649 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 0, 2024-09-10T07:59:31.649 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:31.649 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:31.649 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.001090357, 2024-09-10T07:59:31.649 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T07:59:31.649 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.000173803, 2024-09-10T07:59:31.649 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:31.650 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:31.650 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:31.650 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:31.650 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:31.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.650 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:31.650 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:31.650 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:31.651 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:31.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.651 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T07:59:31.651 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T07:59:31.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.651 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:31.651 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 2, 2024-09-10T07:59:31.651 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 154, 2024-09-10T07:59:31.652 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 320, 2024-09-10T07:59:31.652 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 184240, 2024-09-10T07:59:31.652 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:31.652 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:31.652 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.009724627, 2024-09-10T07:59:31.652 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.006145598, 2024-09-10T07:59:31.652 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.001476471, 2024-09-10T07:59:31.653 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:31.653 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:31.653 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 151, 2024-09-10T07:59:31.653 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.011304066, 2024-09-10T07:59:31.653 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000074861 2024-09-10T07:59:31.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.654 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:31.654 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:31.654 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:31.654 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:31.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.654 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T07:59:31.654 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 184240 2024-09-10T07:59:31.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.655 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:31.655 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 215, 2024-09-10T07:59:31.655 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 203, 2024-09-10T07:59:31.655 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 1443152, 2024-09-10T07:59:31.655 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 123872, 2024-09-10T07:59:31.655 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:31.655 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:31.656 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.038738562, 2024-09-10T07:59:31.656 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.012731781, 2024-09-10T07:59:31.656 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.039134012, 2024-09-10T07:59:31.656 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:31.656 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:31.656 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 203, 2024-09-10T07:59:31.656 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.014089647, 2024-09-10T07:59:31.656 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000069407 2024-09-10T07:59:31.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.657 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:31.657 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:31.657 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:31.657 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:31.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.657 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 1443152, 2024-09-10T07:59:31.658 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 123872 2024-09-10T07:59:31.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.658 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-10T07:59:31.658 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 0, 2024-09-10T07:59:31.658 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-10T07:59:31.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.658 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-10T07:59:31.658 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:31.658 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:31.659 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:31.659 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:31.659 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:31.659 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:31.659 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:31.659 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:31.659 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:31.659 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:31.659 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:31.660 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:31.660 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:31.660 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:31.660 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:31.660 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:31.660 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:31.660 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:31.660 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:31.661 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:31.661 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:31.661 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:31.661 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:31.661 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:31.661 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:31.661 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:31.661 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:31.661 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:31.662 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:31.662 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:31.662 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:31.662 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-10T07:59:31.662 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:31.662 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:31.662 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:31.662 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:31.662 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 148967, 2024-09-10T07:59:31.663 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 29, 2024-09-10T07:59:31.663 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:31.663 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:31.663 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-10T07:59:31.663 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-10T07:59:31.663 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:31.663 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:31.663 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:31.664 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:31.664 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:31.664 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 0, 2024-09-10T07:59:31.664 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:31.664 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:31.664 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:31.664 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-10T07:59:31.664 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:31.665 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 2, 2024-09-10T07:59:31.665 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:31.665 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-10T07:59:31.665 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:31.665 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-10T07:59:31.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:31.665 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:31.666 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-10T07:59:31.666 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-10T07:59:31.666 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-10T07:59:31.666 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 213, 2024-09-10T07:59:31.666 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 1410425, 2024-09-10T07:59:31.666 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:31.666 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 213, 2024-09-10T07:59:31.666 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-10T07:59:31.666 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-10T07:59:31.667 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 213, 2024-09-10T07:59:31.667 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 1410425, 2024-09-10T07:59:31.667 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-10T07:59:31.667 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:31.667 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:31.667 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:31.667 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T07:59:31.667 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T07:59:31.668 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T07:59:32.289 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:32 smithi159 ceph-mon[35522]: pgmap v323: 97 pgs: 97 active+clean; 13 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:59:32.316 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-10T07:59:32.317 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-10T07:59:32.317 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-10T07:59:32.317 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-09-10T07:59:32.317 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T07:59:32.317 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T07:59:32.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:32 smithi102 ceph-mon[35514]: pgmap v323: 97 pgs: 97 active+clean; 13 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:59:32.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:32 smithi073 ceph-mon[30850]: pgmap v323: 97 pgs: 97 active+clean; 13 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T07:59:32.568 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:59:33.046 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T07:59:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 4, 2024-09-10T07:59:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 4, 2024-09-10T07:59:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 2992, 2024-09-10T07:59:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 448, 2024-09-10T07:59:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.003673803, 2024-09-10T07:59:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.000055872, 2024-09-10T07:59:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.002494909, 2024-09-10T07:59:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 3, 2024-09-10T07:59:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.004465155, 2024-09-10T07:59:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001488385 2024-09-10T07:59:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T07:59:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T07:59:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 209, 2024-09-10T07:59:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 199, 2024-09-10T07:59:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 1439616, 2024-09-10T07:59:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 122144, 2024-09-10T07:59:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.035806987, 2024-09-10T07:59:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.012709406, 2024-09-10T07:59:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.036224069, 2024-09-10T07:59:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 198, 2024-09-10T07:59:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.011781495, 2024-09-10T07:59:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000059502 2024-09-10T07:59:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 1439616, 2024-09-10T07:59:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 122144 2024-09-10T07:59:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 2, 2024-09-10T07:59:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 152, 2024-09-10T07:59:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 320, 2024-09-10T07:59:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 183888, 2024-09-10T07:59:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.009373835, 2024-09-10T07:59:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.005857301, 2024-09-10T07:59:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.001632633, 2024-09-10T07:59:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 149, 2024-09-10T07:59:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.019169248, 2024-09-10T07:59:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000128652 2024-09-10T07:59:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T07:59:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 183888 2024-09-10T07:59:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-10T07:59:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 0, 2024-09-10T07:59:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-10T07:59:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-10T07:59:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-10T07:59:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 149017, 2024-09-10T07:59:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 31, 2024-09-10T07:59:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-10T07:59:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-10T07:59:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 0, 2024-09-10T07:59:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-10T07:59:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 2, 2024-09-10T07:59:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-10T07:59:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-10T07:59:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-10T07:59:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-10T07:59:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-10T07:59:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 211, 2024-09-10T07:59:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 1410165, 2024-09-10T07:59:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 211, 2024-09-10T07:59:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-10T07:59:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-10T07:59:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 211, 2024-09-10T07:59:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 1410165, 2024-09-10T07:59:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-10T07:59:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T07:59:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T07:59:33.066 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T07:59:33.747 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.i 2024-09-10T07:59:33.748 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.i 2024-09-10T07:59:33.748 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.i 2024-09-10T07:59:33.748 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.i 2024-09-10T07:59:33.748 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T07:59:33.748 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T07:59:34.001 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T07:59:34.286 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:34 smithi159 ceph-mon[35522]: pgmap v324: 97 pgs: 97 active+clean; 13 GiB data, 79 GiB used, 993 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:59:34.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:34 smithi102 ceph-mon[35514]: pgmap v324: 97 pgs: 97 active+clean; 13 GiB data, 79 GiB used, 993 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:59:34.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:34 smithi073 ceph-mon[30850]: pgmap v324: 97 pgs: 97 active+clean; 13 GiB data, 79 GiB used, 993 GiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-10T07:59:34.488 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T07:59:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T07:59:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 215, 2024-09-10T07:59:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 205, 2024-09-10T07:59:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 1441248, 2024-09-10T07:59:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 125984, 2024-09-10T07:59:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 4, 2024-09-10T07:59:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 0, 2024-09-10T07:59:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.039044111, 2024-09-10T07:59:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.013281034, 2024-09-10T07:59:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.037876222, 2024-09-10T07:59:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 204, 2024-09-10T07:59:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.012237064, 2024-09-10T07:59:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000059985 2024-09-10T07:59:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 1441248, 2024-09-10T07:59:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-10T07:59:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T07:59:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 2, 2024-09-10T07:59:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 158, 2024-09-10T07:59:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 320, 2024-09-10T07:59:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 184944, 2024-09-10T07:59:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-10T07:59:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 3, 2024-09-10T07:59:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.009724178, 2024-09-10T07:59:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.006274819, 2024-09-10T07:59:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.001374729, 2024-09-10T07:59:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 155, 2024-09-10T07:59:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.021569235, 2024-09-10T07:59:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000139156 2024-09-10T07:59:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T07:59:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 184944 2024-09-10T07:59:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T07:59:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 4, 2024-09-10T07:59:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 4, 2024-09-10T07:59:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 2992, 2024-09-10T07:59:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 448, 2024-09-10T07:59:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 2, 2024-09-10T07:59:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 1, 2024-09-10T07:59:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.002207365, 2024-09-10T07:59:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.000041009, 2024-09-10T07:59:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.002178606, 2024-09-10T07:59:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T07:59:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T07:59:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 3, 2024-09-10T07:59:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.003925804, 2024-09-10T07:59:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001308601 2024-09-10T07:59:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-10T07:59:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T07:59:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T07:59:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-10T07:59:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 0, 2024-09-10T07:59:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-10T07:59:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-10T07:59:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-10T07:59:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-10T07:59:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T07:59:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-10T07:59:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T07:59:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-10T07:59:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T07:59:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T07:59:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T07:59:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T07:59:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T07:59:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-10T07:59:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T07:59:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T07:59:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-10T07:59:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-10T07:59:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-10T07:59:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-10T07:59:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T07:59:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T07:59:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T07:59:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T07:59:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T07:59:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-10T07:59:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-10T07:59:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-10T07:59:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T07:59:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T07:59:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-10T07:59:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-10T07:59:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-10T07:59:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-10T07:59:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T07:59:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-10T07:59:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T07:59:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-10T07:59:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 149007, 2024-09-10T07:59:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 30, 2024-09-10T07:59:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-10T07:59:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-10T07:59:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-10T07:59:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-10T07:59:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-10T07:59:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-10T07:59:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-10T07:59:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-10T07:59:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 0, 2024-09-10T07:59:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 0, 2024-09-10T07:59:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T07:59:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-10T07:59:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-10T07:59:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-10T07:59:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 928, 2024-09-10T07:59:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 2, 2024-09-10T07:59:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-10T07:59:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-10T07:59:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-10T07:59:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-10T07:59:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T07:59:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T07:59:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-10T07:59:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-10T07:59:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-10T07:59:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 217, 2024-09-10T07:59:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 1410945, 2024-09-10T07:59:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-10T07:59:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 217, 2024-09-10T07:59:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-10T07:59:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-10T07:59:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 217, 2024-09-10T07:59:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 1410945, 2024-09-10T07:59:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-10T07:59:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-10T07:59:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-10T07:59:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-10T07:59:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T07:59:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T07:59:34.508 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T07:59:35.146 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-10T07:59:35.147 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-10T07:59:35.147 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-10T07:59:35.147 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-10T07:59:35.147 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T07:59:35.158 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T07:59:35.159 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:59:35.159 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:59:35.182 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-10T07:59:35.182 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:59:35.240 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T07:59:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:36.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 -- 172.21.15.73:0/2268044400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 msgr2=0x7f6a3010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2268044400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 0x7f6a3010da40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009ca0 tx=0x7f6a2802a950 comp rx=0 tx=0).stop 2024-09-10T07:59:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 -- 172.21.15.73:0/2268044400 shutdown_connections 2024-09-10T07:59:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2268044400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 0x7f6a3010da40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2268044400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102570 0x7f6a301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2268044400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a30100e20 0x7f6a30101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 -- 172.21.15.73:0/2268044400 >> 172.21.15.73:0/2268044400 conn(0x7f6a300fc7d0 msgr2=0x7f6a300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 -- 172.21.15.73:0/2268044400 shutdown_connections 2024-09-10T07:59:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 -- 172.21.15.73:0/2268044400 wait complete. 2024-09-10T07:59:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 Processor -- start 2024-09-10T07:59:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.977+0000 7f6a378c2640 1 -- start start 2024-09-10T07:59:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a378c2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a30100e20 0x7f6a301984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a378c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102570 0x7f6a30198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a378c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 0x7f6a3019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a378c2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30110fd0 con 0x7f6a30102ef0 2024-09-10T07:59:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a378c2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30110e50 con 0x7f6a30102570 2024-09-10T07:59:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a378c2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30111150 con 0x7f6a30100e20 2024-09-10T07:59:36.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a35e5f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 0x7f6a3019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:36.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a35e5f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 0x7f6a3019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35470/0 (socket says 172.21.15.73:35470) 2024-09-10T07:59:36.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a35e5f640 1 -- 172.21.15.73:0/2798133133 learned_addr learned my addr 172.21.15.73:0/2798133133 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:36.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a3565e640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a30100e20 0x7f6a301984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:36.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a34e5d640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102570 0x7f6a30198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:36.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a35e5f640 1 -- 172.21.15.73:0/2798133133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a30100e20 msgr2=0x7f6a301984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:36.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a35e5f640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a30100e20 0x7f6a301984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:36.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a35e5f640 1 -- 172.21.15.73:0/2798133133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102570 msgr2=0x7f6a30198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:36.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a35e5f640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102570 0x7f6a30198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:36.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a35e5f640 1 -- 172.21.15.73:0/2798133133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3019d480 con 0x7f6a30102ef0 2024-09-10T07:59:36.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a35e5f640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 0x7f6a3019cda0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009dc0 tx=0x7f6a28003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:36.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a267fc640 1 -- 172.21.15.73:0/2798133133 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28034040 con 0x7f6a30102ef0 2024-09-10T07:59:36.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3019d710 con 0x7f6a30102ef0 2024-09-10T07:59:36.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.978+0000 7f6a267fc640 1 -- 172.21.15.73:0/2798133133 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a2802f930 con 0x7f6a30102ef0 2024-09-10T07:59:36.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.979+0000 7f6a267fc640 1 -- 172.21.15.73:0/2798133133 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a280046a0 con 0x7f6a30102ef0 2024-09-10T07:59:36.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.979+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a301a5050 con 0x7f6a30102ef0 2024-09-10T07:59:36.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.979+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a30101200 con 0x7f6a30102ef0 2024-09-10T07:59:36.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.981+0000 7f6a267fc640 1 -- 172.21.15.73:0/2798133133 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6a28037020 con 0x7f6a30102ef0 2024-09-10T07:59:36.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.981+0000 7f6a267fc640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f6a1c0a2cf0 0x7f6a1c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:36.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.982+0000 7f6a267fc640 1 -- 172.21.15.73:0/2798133133 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8672+0+0 (secure 0 0 0) 0x7f6a280f0130 con 0x7f6a30102ef0 2024-09-10T07:59:36.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.982+0000 7f6a3565e640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f6a1c0a2cf0 0x7f6a1c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:36.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.982+0000 7f6a3565e640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f6a1c0a2cf0 0x7f6a1c0a51b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009bd0 tx=0x7f6a2c005f90 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:36.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:35.985+0000 7f6a267fc640 1 -- 172.21.15.73:0/2798133133 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a280bcdd0 con 0x7f6a30102ef0 2024-09-10T07:59:36.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.172+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6a30199830 con 0x7f6a30102ef0 2024-09-10T07:59:36.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.172+0000 7f6a267fc640 1 -- 172.21.15.73:0/2798133133 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v94) ==== 81+0+996 (secure 0 0 0) 0x7f6a30199830 con 0x7f6a30102ef0 2024-09-10T07:59:36.172 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3362975109 2024-09-11T07:49:07.755656+0000 2024-09-10T07:59:36.172 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/662943870 2024-09-11T07:49:07.755656+0000 2024-09-10T07:59:36.172 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1886740002 2024-09-11T07:40:21.601749+0000 2024-09-10T07:59:36.172 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/435372869 2024-09-11T07:40:21.601749+0000 2024-09-10T07:59:36.172 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3218768954 2024-09-11T07:40:44.582011+0000 2024-09-10T07:59:36.172 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3137884334 2024-09-11T07:40:44.582011+0000 2024-09-10T07:59:36.173 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1519662291 2024-09-11T07:40:21.601749+0000 2024-09-10T07:59:36.173 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1757694921 2024-09-11T07:49:07.755656+0000 2024-09-10T07:59:36.173 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1256602106 2024-09-11T07:40:21.601749+0000 2024-09-10T07:59:36.173 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/142266274 2024-09-11T07:40:44.582011+0000 2024-09-10T07:59:36.173 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1430464896 2024-09-11T07:49:07.755656+0000 2024-09-10T07:59:36.173 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/601110519 2024-09-11T07:40:44.582011+0000 2024-09-10T07:59:36.173 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/662943870 2024-09-11T07:49:07.755656+0000 2024-09-10T07:59:36.174 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/142266274 2024-09-11T07:40:44.582011+0000 2024-09-10T07:59:36.174 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/435372869 2024-09-11T07:40:21.601749+0000 2024-09-10T07:59:36.174 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2752680748 2024-09-11T07:49:07.755656+0000 2024-09-10T07:59:36.174 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/643669867 2024-09-11T07:49:07.755656+0000 2024-09-10T07:59:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:listed 17 entries 2024-09-10T07:59:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f6a1c0a2cf0 msgr2=0x7f6a1c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f6a1c0a2cf0 0x7f6a1c0a51b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009bd0 tx=0x7f6a2c005f90 comp rx=0 tx=0).stop 2024-09-10T07:59:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 msgr2=0x7f6a3019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 0x7f6a3019cda0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009dc0 tx=0x7f6a28003c10 comp rx=0 tx=0).stop 2024-09-10T07:59:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 shutdown_connections 2024-09-10T07:59:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f6a1c0a2cf0 0x7f6a1c0a51b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a30102ef0 0x7f6a3019cda0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102570 0x7f6a30198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 --2- 172.21.15.73:0/2798133133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a30100e20 0x7f6a301984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 >> 172.21.15.73:0/2798133133 conn(0x7f6a300fc7d0 msgr2=0x7f6a3006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 shutdown_connections 2024-09-10T07:59:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:36.174+0000 7f6a378c2640 1 -- 172.21.15.73:0/2798133133 wait complete. 2024-09-10T07:59:36.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:36 smithi102 ceph-mon[35514]: pgmap v325: 97 pgs: 97 active+clean; 13 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:59:36.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:36 smithi159 ceph-mon[35522]: pgmap v325: 97 pgs: 97 active+clean; 13 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:59:36.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:36 smithi073 ceph-mon[30850]: pgmap v325: 97 pgs: 97 active+clean; 13 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:59:36.756 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:59:36.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:59:36.757 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:59:37.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:37 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/2798133133' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T07:59:37.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:37 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/2798133133' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T07:59:37.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:37 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/2798133133' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T07:59:37.520 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T07:59:37.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:59:37.521 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:59:37.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:59:37.573 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-10T07:59:37.618 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:59:37.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:59:37.619 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:59:37.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:59:37.704 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-09-10T07:59:37.776 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T07:59:37.789 INFO:tasks.cephadm:Teardown begin 2024-09-10T07:59:37.790 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:59:37.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:59:38.049 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:38.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:38 smithi073 ceph-mon[30850]: pgmap v326: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:59:38.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:38 smithi102 ceph-mon[35514]: pgmap v326: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:59:38.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:38 smithi159 ceph-mon[35522]: pgmap v326: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T07:59:38.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.528+0000 7f1fc4620640 1 -- 172.21.15.73:0/1279627390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc100a80 msgr2=0x7f1fbc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:38.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.528+0000 7f1fc4620640 1 --2- 172.21.15.73:0/1279627390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc100a80 0x7f1fbc100ee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009930 tx=0x7f1fac02a420 comp rx=0 tx=0).stop 2024-09-10T07:59:38.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.528+0000 7f1fc4620640 1 -- 172.21.15.73:0/1279627390 shutdown_connections 2024-09-10T07:59:38.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.528+0000 7f1fc4620640 1 --2- 172.21.15.73:0/1279627390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fbc101420 0x7f1fbc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.528+0000 7f1fc4620640 1 --2- 172.21.15.73:0/1279627390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc100a80 0x7f1fbc100ee0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.528+0000 7f1fc4620640 1 --2- 172.21.15.73:0/1279627390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc106a80 0x7f1fbc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.528+0000 7f1fc4620640 1 -- 172.21.15.73:0/1279627390 >> 172.21.15.73:0/1279627390 conn(0x7f1fbc0fc7a0 msgr2=0x7f1fbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:38.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.528+0000 7f1fc4620640 1 -- 172.21.15.73:0/1279627390 shutdown_connections 2024-09-10T07:59:38.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.528+0000 7f1fc4620640 1 -- 172.21.15.73:0/1279627390 wait complete. 2024-09-10T07:59:38.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc4620640 1 Processor -- start 2024-09-10T07:59:38.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc4620640 1 -- start start 2024-09-10T07:59:38.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc4620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fbc100a80 0x7f1fbc1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:38.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc4620640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc101420 0x7f1fbc1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:38.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc4620640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc106a80 0x7f1fbc19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:38.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc4620640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc110ed0 con 0x7f1fbc106a80 2024-09-10T07:59:38.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc4620640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc110d50 con 0x7f1fbc100a80 2024-09-10T07:59:38.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc4620640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc111050 con 0x7f1fbc101420 2024-09-10T07:59:38.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc2bbd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc106a80 0x7f1fbc19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:38.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc1bbb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc101420 0x7f1fbc1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:38.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc1bbb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc101420 0x7f1fbc1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.73:39114/0 (socket says 172.21.15.73:39114) 2024-09-10T07:59:38.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc1bbb640 1 -- 172.21.15.73:0/45746094 learned_addr learned my addr 172.21.15.73:0/45746094 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:38.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc23bc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fbc100a80 0x7f1fbc1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:38.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.529+0000 7f1fc2bbd640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc106a80 0x7f1fbc19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35496/0 (socket says 172.21.15.73:35496) 2024-09-10T07:59:38.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc23bc640 1 -- 172.21.15.73:0/45746094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc101420 msgr2=0x7f1fbc1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:38.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc23bc640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc101420 0x7f1fbc1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc23bc640 1 -- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc106a80 msgr2=0x7f1fbc19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:38.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc23bc640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc106a80 0x7f1fbc19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc23bc640 1 -- 172.21.15.73:0/45746094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc19d460 con 0x7f1fbc100a80 2024-09-10T07:59:38.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc2bbd640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc106a80 0x7f1fbc19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:59:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc1bbb640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc101420 0x7f1fbc1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:59:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc23bc640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fbc100a80 0x7f1fbc1984b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009fd0 tx=0x7f1fb800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fb37fe640 1 -- 172.21.15.73:0/45746094 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8004b20 con 0x7f1fbc100a80 2024-09-10T07:59:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc19d750 con 0x7f1fbc100a80 2024-09-10T07:59:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fb37fe640 1 -- 172.21.15.73:0/45746094 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fb8004cc0 con 0x7f1fbc100a80 2024-09-10T07:59:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fb37fe640 1 -- 172.21.15.73:0/45746094 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb80107b0 con 0x7f1fbc100a80 2024-09-10T07:59:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.530+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc1a5030 con 0x7f1fbc100a80 2024-09-10T07:59:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.531+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fbc100ee0 con 0x7f1fbc100a80 2024-09-10T07:59:38.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.532+0000 7f1fb37fe640 1 -- 172.21.15.73:0/45746094 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1fb8005020 con 0x7f1fbc100a80 2024-09-10T07:59:38.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.533+0000 7f1fb37fe640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f1fa80a2cf0 0x7f1fa80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:38.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.533+0000 7f1fc1bbb640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f1fa80a2cf0 0x7f1fa80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:38.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.533+0000 7f1fb37fe640 1 -- 172.21.15.73:0/45746094 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8672+0+0 (secure 0 0 0) 0x7f1fb80cfbf0 con 0x7f1fbc100a80 2024-09-10T07:59:38.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.533+0000 7f1fc1bbb640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f1fa80a2cf0 0x7f1fa80a51b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc1051d0 tx=0x7f1fac031510 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:38.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.537+0000 7f1fb37fe640 1 -- 172.21.15.73:0/45746094 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1fb809c780 con 0x7f1fbc100a80 2024-09-10T07:59:38.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.753+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fbc10a030 con 0x7f1fbc100a80 2024-09-10T07:59:38.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.754+0000 7f1fb37fe640 1 -- 172.21.15.73:0/45746094 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11853 (secure 0 0 0) 0x7f1fb809c080 con 0x7f1fbc100a80 2024-09-10T07:59:38.754 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:59:38.754 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"btime":"2024-09-10T07:47:42:148674+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T07:47:32.394994+0000","modified":"2024-09-10T07:47:41.846317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6839/330469529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":330469529},{"type":"v1","addr":"172.21.15.102:6839","nonce":330469529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-10T07:59:38.754 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-10T07:59:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f1fa80a2cf0 msgr2=0x7f1fa80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f1fa80a2cf0 0x7f1fa80a51b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc1051d0 tx=0x7f1fac031510 comp rx=0 tx=0).stop 2024-09-10T07:59:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fbc100a80 msgr2=0x7f1fbc1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fbc100a80 0x7f1fbc1984b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009fd0 tx=0x7f1fb800ef90 comp rx=0 tx=0).stop 2024-09-10T07:59:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 shutdown_connections 2024-09-10T07:59:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f1fa80a2cf0 0x7f1fa80a51b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fbc106a80 0x7f1fbc19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc101420 0x7f1fbc1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 --2- 172.21.15.73:0/45746094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fbc100a80 0x7f1fbc1984b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 >> 172.21.15.73:0/45746094 conn(0x7f1fbc0fc7a0 msgr2=0x7f1fbc06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.756+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 shutdown_connections 2024-09-10T07:59:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:38.757+0000 7f1fc4620640 1 -- 172.21.15.73:0/45746094 wait complete. 2024-09-10T07:59:39.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:39 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/45746094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:59:39.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:39 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/45746094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:59:39.422 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:39 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/45746094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:59:39.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T07:59:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:40.076 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:40 smithi073 ceph-mon[30850]: pgmap v327: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:59:40.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.157+0000 7f0b6062f640 1 -- 172.21.15.73:0/1437648076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 msgr2=0x7f0b581029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:40.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.157+0000 7f0b6062f640 1 --2- 172.21.15.73:0/1437648076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 0x7f0b581029b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009900 tx=0x7f0b4c02a480 comp rx=0 tx=0).stop 2024-09-10T07:59:40.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.157+0000 7f0b6062f640 1 -- 172.21.15.73:0/1437648076 shutdown_connections 2024-09-10T07:59:40.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.157+0000 7f0b6062f640 1 --2- 172.21.15.73:0/1437648076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b58102ef0 0x7f0b5810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.157+0000 7f0b6062f640 1 --2- 172.21.15.73:0/1437648076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 0x7f0b581029b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.157+0000 7f0b6062f640 1 --2- 172.21.15.73:0/1437648076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b58100e20 0x7f0b58101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.157+0000 7f0b6062f640 1 -- 172.21.15.73:0/1437648076 >> 172.21.15.73:0/1437648076 conn(0x7f0b580fc7d0 msgr2=0x7f0b580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:40.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.157+0000 7f0b6062f640 1 -- 172.21.15.73:0/1437648076 shutdown_connections 2024-09-10T07:59:40.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.157+0000 7f0b6062f640 1 -- 172.21.15.73:0/1437648076 wait complete. 2024-09-10T07:59:40.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b6062f640 1 Processor -- start 2024-09-10T07:59:40.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b6062f640 1 -- start start 2024-09-10T07:59:40.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b6062f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b58100e20 0x7f0b58198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:40.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b6062f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 0x7f0b58198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:40.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b6062f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b58102ef0 0x7f0b5819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b6062f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0b58110f50 con 0x7f0b58102570 2024-09-10T07:59:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b6062f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0b58110dd0 con 0x7f0b58102ef0 2024-09-10T07:59:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b6062f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0b581110d0 con 0x7f0b58100e20 2024-09-10T07:59:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b5dbca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 0x7f0b58198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b5dbca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 0x7f0b58198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58560/0 (socket says 172.21.15.73:58560) 2024-09-10T07:59:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b5dbca640 1 -- 172.21.15.73:0/815640842 learned_addr learned my addr 172.21.15.73:0/815640842 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b5ebcc640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b58102ef0 0x7f0b5819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b5e3cb640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b58100e20 0x7f0b58198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:40.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b5dbca640 1 -- 172.21.15.73:0/815640842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b58100e20 msgr2=0x7f0b58198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:40.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b5dbca640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b58100e20 0x7f0b58198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b5dbca640 1 -- 172.21.15.73:0/815640842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b58102ef0 msgr2=0x7f0b5819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:40.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.158+0000 7f0b5dbca640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b58102ef0 0x7f0b5819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.159+0000 7f0b5dbca640 1 -- 172.21.15.73:0/815640842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5819d500 con 0x7f0b58102570 2024-09-10T07:59:40.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.159+0000 7f0b5e3cb640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b58100e20 0x7f0b58198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:59:40.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.159+0000 7f0b5dbca640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 0x7f0b58198a90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c006010 tx=0x7f0b4c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.159+0000 7f0b577fe640 1 -- 172.21.15.73:0/815640842 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c03f070 con 0x7f0b58102570 2024-09-10T07:59:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.159+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5819d790 con 0x7f0b58102570 2024-09-10T07:59:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.159+0000 7f0b577fe640 1 -- 172.21.15.73:0/815640842 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b4c031c30 con 0x7f0b58102570 2024-09-10T07:59:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.159+0000 7f0b577fe640 1 -- 172.21.15.73:0/815640842 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c035030 con 0x7f0b58102570 2024-09-10T07:59:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.159+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b581a50d0 con 0x7f0b58102570 2024-09-10T07:59:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.160+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b58101200 con 0x7f0b58102570 2024-09-10T07:59:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.161+0000 7f0b577fe640 1 -- 172.21.15.73:0/815640842 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0b4c042070 con 0x7f0b58102570 2024-09-10T07:59:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.162+0000 7f0b577fe640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0b400a2cf0 0x7f0b400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:40.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.162+0000 7f0b5e3cb640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0b400a2cf0 0x7f0b400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:40.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.162+0000 7f0b577fe640 1 -- 172.21.15.73:0/815640842 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8672+0+0 (secure 0 0 0) 0x7f0b4c0f0170 con 0x7f0b58102570 2024-09-10T07:59:40.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.162+0000 7f0b5e3cb640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0b400a2cf0 0x7f0b400a51b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b50005fd0 tx=0x7f0b50009500 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:40.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.165+0000 7f0b577fe640 1 -- 172.21.15.73:0/815640842 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b4c0bcd00 con 0x7f0b58102570 2024-09-10T07:59:40.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:40 smithi102 ceph-mon[35514]: pgmap v327: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:59:40.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.382+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b581998b0 con 0x7f0b58102570 2024-09-10T07:59:40.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.383+0000 7f0b577fe640 1 -- 172.21.15.73:0/815640842 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11853 (secure 0 0 0) 0x7f0b581998b0 con 0x7f0b58102570 2024-09-10T07:59:40.382 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:59:40.383 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"btime":"2024-09-10T07:47:42:148674+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2591378942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2591378942},{"type":"v1","addr":"172.21.15.73:6835","nonce":2591378942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/960559845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":960559845},{"type":"v1","addr":"172.21.15.73:6837","nonce":960559845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/3892628797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":3892628797},{"type":"v1","addr":"172.21.15.73:6839","nonce":3892628797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/1022312425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":1022312425},{"type":"v1","addr":"172.21.15.73:6841","nonce":1022312425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/4146480241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4146480241},{"type":"v1","addr":"172.21.15.159:6833","nonce":4146480241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/440517114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":440517114},{"type":"v1","addr":"172.21.15.102:6833","nonce":440517114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3867563502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3867563502},{"type":"v1","addr":"172.21.15.159:6835","nonce":3867563502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1843594994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1843594994},{"type":"v1","addr":"172.21.15.159:6837","nonce":1843594994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2327482046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2327482046},{"type":"v1","addr":"172.21.15.102:6835","nonce":2327482046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2574665327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2574665327},{"type":"v1","addr":"172.21.15.159:6839","nonce":2574665327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T07:47:32.394994+0000","modified":"2024-09-10T07:47:41.846317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6837/801459300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":801459300},{"type":"v1","addr":"172.21.15.102:6837","nonce":801459300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6839/330469529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":330469529},{"type":"v1","addr":"172.21.15.102:6839","nonce":330469529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-10T07:59:40.383 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-10T07:59:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0b400a2cf0 msgr2=0x7f0b400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0b400a2cf0 0x7f0b400a51b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b50005fd0 tx=0x7f0b50009500 comp rx=0 tx=0).stop 2024-09-10T07:59:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 msgr2=0x7f0b58198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 0x7f0b58198a90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c006010 tx=0x7f0b4c003c10 comp rx=0 tx=0).stop 2024-09-10T07:59:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 shutdown_connections 2024-09-10T07:59:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f0b400a2cf0 0x7f0b400a51b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b58102ef0 0x7f0b5819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b58102570 0x7f0b58198a90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 --2- 172.21.15.73:0/815640842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b58100e20 0x7f0b58198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 >> 172.21.15.73:0/815640842 conn(0x7f0b580fc7d0 msgr2=0x7f0b5806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:40.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 shutdown_connections 2024-09-10T07:59:40.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:40.385+0000 7f0b6062f640 1 -- 172.21.15.73:0/815640842 wait complete. 2024-09-10T07:59:40.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:40 smithi159 ceph-mon[35522]: pgmap v327: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-10T07:59:40.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T07:59:41.156 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:41.157 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:41 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/815640842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:59:41.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:41 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/815640842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:59:41.376 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:41 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/815640842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T07:59:41.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.564+0000 7f461a6af640 1 -- 172.21.15.73:0/3628072788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614106a80 msgr2=0x7f4614106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:41.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.564+0000 7f461a6af640 1 --2- 172.21.15.73:0/3628072788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614106a80 0x7f4614106e60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4604009930 tx=0x7f460402a420 comp rx=0 tx=0).stop 2024-09-10T07:59:41.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.564+0000 7f461a6af640 1 -- 172.21.15.73:0/3628072788 shutdown_connections 2024-09-10T07:59:41.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.564+0000 7f461a6af640 1 --2- 172.21.15.73:0/3628072788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4614101420 0x7f461410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:41.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.564+0000 7f461a6af640 1 --2- 172.21.15.73:0/3628072788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4614100a80 0x7f4614100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:41.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.564+0000 7f461a6af640 1 --2- 172.21.15.73:0/3628072788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614106a80 0x7f4614106e60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:41.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.564+0000 7f461a6af640 1 -- 172.21.15.73:0/3628072788 >> 172.21.15.73:0/3628072788 conn(0x7f46140fc7a0 msgr2=0x7f46140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:41.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.564+0000 7f461a6af640 1 -- 172.21.15.73:0/3628072788 shutdown_connections 2024-09-10T07:59:41.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.564+0000 7f461a6af640 1 -- 172.21.15.73:0/3628072788 wait complete. 2024-09-10T07:59:41.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f461a6af640 1 Processor -- start 2024-09-10T07:59:41.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f461a6af640 1 -- start start 2024-09-10T07:59:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f461a6af640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614100a80 0x7f4614198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f461a6af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4614101420 0x7f46141989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f461a6af640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4614106a80 0x7f461419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f461a6af640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4614110e80 con 0x7f4614100a80 2024-09-10T07:59:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f461a6af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4614110d00 con 0x7f4614101420 2024-09-10T07:59:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f461a6af640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4614111000 con 0x7f4614106a80 2024-09-10T07:59:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f4613fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614100a80 0x7f4614198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f4613fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614100a80 0x7f4614198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58584/0 (socket says 172.21.15.73:58584) 2024-09-10T07:59:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f4613fff640 1 -- 172.21.15.73:0/3033453446 learned_addr learned my addr 172.21.15.73:0/3033453446 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f46137fe640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4614101420 0x7f46141989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.565+0000 7f4618c4c640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4614106a80 0x7f461419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f4613fff640 1 -- 172.21.15.73:0/3033453446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4614106a80 msgr2=0x7f461419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f4613fff640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4614106a80 0x7f461419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f4613fff640 1 -- 172.21.15.73:0/3033453446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4614101420 msgr2=0x7f46141989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f4613fff640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4614101420 0x7f46141989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f4613fff640 1 -- 172.21.15.73:0/3033453446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461419d410 con 0x7f4614100a80 2024-09-10T07:59:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f4613fff640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614100a80 0x7f4614198460 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4604009230 tx=0x7f4604004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:41.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f46117fa640 1 -- 172.21.15.73:0/3033453446 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460403f030 con 0x7f4614100a80 2024-09-10T07:59:41.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461419d6a0 con 0x7f4614100a80 2024-09-10T07:59:41.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f46117fa640 1 -- 172.21.15.73:0/3033453446 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4604003ad0 con 0x7f4614100a80 2024-09-10T07:59:41.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f46117fa640 1 -- 172.21.15.73:0/3033453446 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604035070 con 0x7f4614100a80 2024-09-10T07:59:41.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.566+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46141a4fe0 con 0x7f4614100a80 2024-09-10T07:59:41.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.567+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46141021c0 con 0x7f4614100a80 2024-09-10T07:59:41.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.568+0000 7f46117fa640 1 -- 172.21.15.73:0/3033453446 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4604042030 con 0x7f4614100a80 2024-09-10T07:59:41.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.569+0000 7f46117fa640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f45fc0a2cf0 0x7f45fc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:41.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.569+0000 7f46137fe640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f45fc0a2cf0 0x7f45fc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:41.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.569+0000 7f46117fa640 1 -- 172.21.15.73:0/3033453446 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8672+0+0 (secure 0 0 0) 0x7f46040efec0 con 0x7f4614100a80 2024-09-10T07:59:41.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.569+0000 7f46137fe640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f45fc0a2cf0 0x7f45fc0a51b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4614105200 tx=0x7f460800b410 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:41.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.572+0000 7f46117fa640 1 -- 172.21.15.73:0/3033453446 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46040bc400 con 0x7f4614100a80 2024-09-10T07:59:41.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.748+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f461410a000 con 0x7f4614100a80 2024-09-10T07:59:41.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.750+0000 7f46117fa640 1 -- 172.21.15.73:0/3033453446 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+23479 (secure 0 0 0) 0x7f46040c0700 con 0x7f4614100a80 2024-09-10T07:59:41.750 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-10T07:59:41.750 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":94,"fsid":"c025e280-6f47-11ef-bcea-c7b262605968","created":"2024-09-10T07:39:59.865107+0000","modified":"2024-09-10T07:59:20.264806+0000","last_up_change":"2024-09-10T07:46:43.522673+0000","last_in_change":"2024-09-10T07:46:19.814484+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:42:58.876964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:47:28.792230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:47:30.666653+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6e507ac-4881-43ea-95a6-3df7feba2a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6803","nonce":2484484549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6805","nonce":2484484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6809","nonce":2484484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2484484549},{"type":"v1","addr":"172.21.15.73:6807","nonce":2484484549}]},"public_addr":"172.21.15.73:6803/2484484549","cluster_addr":"172.21.15.73:6805/2484484549","heartbeat_back_addr":"172.21.15.73:6809/2484484549","heartbeat_front_addr":"172.21.15.73:6807/2484484549","state":["exists","up"]},{"osd":1,"uuid":"5e703b50-3e28-499d-a8c4-4068826a16fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6801","nonce":2799530792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6803","nonce":2799530792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6807","nonce":2799530792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2799530792},{"type":"v1","addr":"172.21.15.102:6805","nonce":2799530792}]},"public_addr":"172.21.15.102:6801/2799530792","cluster_addr":"172.21.15.102:6803/2799530792","heartbeat_back_addr":"172.21.15.102:6807/2799530792","heartbeat_front_addr":"172.21.15.102:6805/2799530792","state":["exists","up"]},{"osd":2,"uuid":"12fdc851-2a35-4284-8351-1e213d072217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6801","nonce":399686277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6803","nonce":399686277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6807","nonce":399686277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":399686277},{"type":"v1","addr":"172.21.15.159:6805","nonce":399686277}]},"public_addr":"172.21.15.159:6801/399686277","cluster_addr":"172.21.15.159:6803/399686277","heartbeat_back_addr":"172.21.15.159:6807/399686277","heartbeat_front_addr":"172.21.15.159:6805/399686277","state":["exists","up"]},{"osd":3,"uuid":"39f87c5a-d0b1-49d1-bdea-cb24d2c1b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6811","nonce":2078486916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6813","nonce":2078486916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6817","nonce":2078486916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2078486916},{"type":"v1","addr":"172.21.15.73:6815","nonce":2078486916}]},"public_addr":"172.21.15.73:6811/2078486916","cluster_addr":"172.21.15.73:6813/2078486916","heartbeat_back_addr":"172.21.15.73:6817/2078486916","heartbeat_front_addr":"172.21.15.73:6815/2078486916","state":["exists","up"]},{"osd":4,"uuid":"294eff0e-74d3-4a3c-a512-de8e6878e66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1176212807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1176212807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1176212807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1176212807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1176212807}]},"public_addr":"172.21.15.102:6809/1176212807","cluster_addr":"172.21.15.102:6811/1176212807","heartbeat_back_addr":"172.21.15.102:6815/1176212807","heartbeat_front_addr":"172.21.15.102:6813/1176212807","state":["exists","up"]},{"osd":5,"uuid":"71a0406f-9981-4c62-9795-e69112b5c4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6809","nonce":877454458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6811","nonce":877454458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6815","nonce":877454458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":877454458},{"type":"v1","addr":"172.21.15.159:6813","nonce":877454458}]},"public_addr":"172.21.15.159:6809/877454458","cluster_addr":"172.21.15.159:6811/877454458","heartbeat_back_addr":"172.21.15.159:6815/877454458","heartbeat_front_addr":"172.21.15.159:6813/877454458","state":["exists","up"]},{"osd":6,"uuid":"495420b2-33d4-4278-9ed9-fec2371e2780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6819","nonce":3759904745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6821","nonce":3759904745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6825","nonce":3759904745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3759904745},{"type":"v1","addr":"172.21.15.73:6823","nonce":3759904745}]},"public_addr":"172.21.15.73:6819/3759904745","cluster_addr":"172.21.15.73:6821/3759904745","heartbeat_back_addr":"172.21.15.73:6825/3759904745","heartbeat_front_addr":"172.21.15.73:6823/3759904745","state":["exists","up"]},{"osd":7,"uuid":"4674c7d2-204a-4a52-aaa8-0e242e9daa80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6817","nonce":120865394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6819","nonce":120865394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6823","nonce":120865394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":120865394},{"type":"v1","addr":"172.21.15.102:6821","nonce":120865394}]},"public_addr":"172.21.15.102:6817/120865394","cluster_addr":"172.21.15.102:6819/120865394","heartbeat_back_addr":"172.21.15.102:6823/120865394","heartbeat_front_addr":"172.21.15.102:6821/120865394","state":["exists","up"]},{"osd":8,"uuid":"c526c9b3-de80-4151-b6e2-2177cc83b83a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6817","nonce":651574566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6819","nonce":651574566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6823","nonce":651574566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":651574566},{"type":"v1","addr":"172.21.15.159:6821","nonce":651574566}]},"public_addr":"172.21.15.159:6817/651574566","cluster_addr":"172.21.15.159:6819/651574566","heartbeat_back_addr":"172.21.15.159:6823/651574566","heartbeat_front_addr":"172.21.15.159:6821/651574566","state":["exists","up"]},{"osd":9,"uuid":"de89cdd5-3f64-4fad-ac2d-9ff283cb0eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6827","nonce":3756582500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6829","nonce":3756582500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6833","nonce":3756582500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":3756582500},{"type":"v1","addr":"172.21.15.73:6831","nonce":3756582500}]},"public_addr":"172.21.15.73:6827/3756582500","cluster_addr":"172.21.15.73:6829/3756582500","heartbeat_back_addr":"172.21.15.73:6833/3756582500","heartbeat_front_addr":"172.21.15.73:6831/3756582500","state":["exists","up"]},{"osd":10,"uuid":"6c3b4106-5ee9-49ec-b8ec-94aed62d4cb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6825","nonce":2640871897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6827","nonce":2640871897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6831","nonce":2640871897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2640871897},{"type":"v1","addr":"172.21.15.102:6829","nonce":2640871897}]},"public_addr":"172.21.15.102:6825/2640871897","cluster_addr":"172.21.15.102:6827/2640871897","heartbeat_back_addr":"172.21.15.102:6831/2640871897","heartbeat_front_addr":"172.21.15.102:6829/2640871897","state":["exists","up"]},{"osd":11,"uuid":"6a0166b5-4a2f-4b6d-a0d8-179aeab7bd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6825","nonce":1651446392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6827","nonce":1651446392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6831","nonce":1651446392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1651446392},{"type":"v1","addr":"172.21.15.159:6829","nonce":1651446392}]},"public_addr":"172.21.15.159:6825/1651446392","cluster_addr":"172.21.15.159:6827/1651446392","heartbeat_back_addr":"172.21.15.159:6831/1651446392","heartbeat_front_addr":"172.21.15.159:6829/1651446392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:07.224783+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:32.526187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:42:56.675098+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:22.104235+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:43:47.484953+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:12.106807+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:44:36.583373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:01.614962+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:25.842475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:45:51.706245+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:16.532203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:46:41.558602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/3362975109":"2024-09-11T07:49:07.755656+0000","172.21.15.73:6801/662943870":"2024-09-11T07:49:07.755656+0000","172.21.15.73:0/1886740002":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/3218768954":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/3137884334":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1519662291":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/1757694921":"2024-09-11T07:49:07.755656+0000","172.21.15.73:0/1256602106":"2024-09-11T07:40:21.601749+0000","172.21.15.73:6800/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:0/1430464896":"2024-09-11T07:49:07.755656+0000","172.21.15.73:0/601110519":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6800/662943870":"2024-09-11T07:49:07.755656+0000","172.21.15.73:6801/142266274":"2024-09-11T07:40:44.582011+0000","172.21.15.73:6801/435372869":"2024-09-11T07:40:21.601749+0000","172.21.15.73:0/2752680748":"2024-09-11T07:49:07.755656+0000","172.21.15.73:0/643669867":"2024-09-11T07:49:07.755656+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:59:41.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f45fc0a2cf0 msgr2=0x7f45fc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:41.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f45fc0a2cf0 0x7f45fc0a51b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4614105200 tx=0x7f460800b410 comp rx=0 tx=0).stop 2024-09-10T07:59:41.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614100a80 msgr2=0x7f4614198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:41.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614100a80 0x7f4614198460 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4604009230 tx=0x7f4604004270 comp rx=0 tx=0).stop 2024-09-10T07:59:41.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 shutdown_connections 2024-09-10T07:59:41.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f45fc0a2cf0 0x7f45fc0a51b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:41.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4614106a80 0x7f461419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:41.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4614101420 0x7f46141989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:41.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 --2- 172.21.15.73:0/3033453446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4614100a80 0x7f4614198460 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:41.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 >> 172.21.15.73:0/3033453446 conn(0x7f46140fc7a0 msgr2=0x7f461406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:41.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 shutdown_connections 2024-09-10T07:59:41.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:41.752+0000 7f461a6af640 1 -- 172.21.15.73:0/3033453446 wait complete. 2024-09-10T07:59:42.370 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:42 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3033453446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:59:42.370 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:42 smithi073 ceph-mon[30850]: pgmap v328: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:59:42.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:42 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3033453446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:59:42.375 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:42 smithi102 ceph-mon[35514]: pgmap v328: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:59:42.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T07:59:42.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:42 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3033453446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T07:59:42.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:42 smithi159 ceph-mon[35522]: pgmap v328: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T07:59:42.649 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:43.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.083+0000 7fce84b7e640 1 -- 172.21.15.73:0/716587616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 msgr2=0x7fce801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:43.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.083+0000 7fce84b7e640 1 --2- 172.21.15.73:0/716587616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 0x7fce801029b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fce70009900 tx=0x7fce7002a480 comp rx=0 tx=0).stop 2024-09-10T07:59:43.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.083+0000 7fce84b7e640 1 -- 172.21.15.73:0/716587616 shutdown_connections 2024-09-10T07:59:43.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.083+0000 7fce84b7e640 1 --2- 172.21.15.73:0/716587616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce80102ef0 0x7fce8010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.083+0000 7fce84b7e640 1 --2- 172.21.15.73:0/716587616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 0x7fce801029b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.083+0000 7fce84b7e640 1 --2- 172.21.15.73:0/716587616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce80100e20 0x7fce80101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.083+0000 7fce84b7e640 1 -- 172.21.15.73:0/716587616 >> 172.21.15.73:0/716587616 conn(0x7fce800fc7d0 msgr2=0x7fce800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:43.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.083+0000 7fce84b7e640 1 -- 172.21.15.73:0/716587616 shutdown_connections 2024-09-10T07:59:43.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.083+0000 7fce84b7e640 1 -- 172.21.15.73:0/716587616 wait complete. 2024-09-10T07:59:43.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.084+0000 7fce84b7e640 1 Processor -- start 2024-09-10T07:59:43.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.084+0000 7fce84b7e640 1 -- start start 2024-09-10T07:59:43.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.084+0000 7fce84b7e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce80100e20 0x7fce80197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:43.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.084+0000 7fce84b7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 0x7fce80197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:43.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.084+0000 7fce84b7e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce80102ef0 0x7fce8019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:43.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.084+0000 7fce84b7e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fce80110fd0 con 0x7fce80102570 2024-09-10T07:59:43.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce84b7e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fce80110e50 con 0x7fce80100e20 2024-09-10T07:59:43.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce84b7e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fce80111150 con 0x7fce80102ef0 2024-09-10T07:59:43.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 0x7fce80197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:43.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 0x7fce80197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58608/0 (socket says 172.21.15.73:58608) 2024-09-10T07:59:43.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7dd9b640 1 -- 172.21.15.73:0/174700010 learned_addr learned my addr 172.21.15.73:0/174700010 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:43.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7e59c640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce80100e20 0x7fce80197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:43.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7ed9d640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce80102ef0 0x7fce8019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:43.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7dd9b640 1 -- 172.21.15.73:0/174700010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce80102ef0 msgr2=0x7fce8019bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:43.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7dd9b640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce80102ef0 0x7fce8019bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7dd9b640 1 -- 172.21.15.73:0/174700010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce80100e20 msgr2=0x7fce80197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:43.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7dd9b640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce80100e20 0x7fce80197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7dd9b640 1 -- 172.21.15.73:0/174700010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8019c400 con 0x7fce80102570 2024-09-10T07:59:43.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7e59c640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce80100e20 0x7fce80197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:59:43.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce7dd9b640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 0x7fce80197990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fce7002aa70 tx=0x7fce70003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce777fe640 1 -- 172.21.15.73:0/174700010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7003f070 con 0x7fce80102570 2024-09-10T07:59:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce777fe640 1 -- 172.21.15.73:0/174700010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce70031c30 con 0x7fce80102570 2024-09-10T07:59:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8019c690 con 0x7fce80102570 2024-09-10T07:59:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce777fe640 1 -- 172.21.15.73:0/174700010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70035030 con 0x7fce80102570 2024-09-10T07:59:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.085+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce80069f70 con 0x7fce80102570 2024-09-10T07:59:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.086+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce801021b0 con 0x7fce80102570 2024-09-10T07:59:43.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.088+0000 7fce777fe640 1 -- 172.21.15.73:0/174700010 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fce70042070 con 0x7fce80102570 2024-09-10T07:59:43.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.088+0000 7fce777fe640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fce6c0a2cf0 0x7fce6c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:43.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.088+0000 7fce7e59c640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fce6c0a2cf0 0x7fce6c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:43.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.088+0000 7fce777fe640 1 -- 172.21.15.73:0/174700010 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8672+0+0 (secure 0 0 0) 0x7fce700f01c0 con 0x7fce80102570 2024-09-10T07:59:43.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.089+0000 7fce7e59c640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fce6c0a2cf0 0x7fce6c0a51b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce68009fc0 tx=0x7fce68005f90 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:43.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.091+0000 7fce777fe640 1 -- 172.21.15.73:0/174700010 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce70031de0 con 0x7fce80102570 2024-09-10T07:59:43.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.302+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fce801987b0 con 0x7fce80102570 2024-09-10T07:59:43.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.310+0000 7fce777fe640 1 -- 172.21.15.73:0/174700010 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7fce700bc700 con 0x7fce80102570 2024-09-10T07:59:43.309 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:59:43.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fce6c0a2cf0 msgr2=0x7fce6c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:43.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fce6c0a2cf0 0x7fce6c0a51b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce68009fc0 tx=0x7fce68005f90 comp rx=0 tx=0).stop 2024-09-10T07:59:43.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 msgr2=0x7fce80197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:43.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 0x7fce80197990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fce7002aa70 tx=0x7fce70003c10 comp rx=0 tx=0).stop 2024-09-10T07:59:43.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 shutdown_connections 2024-09-10T07:59:43.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fce6c0a2cf0 0x7fce6c0a51b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce80102ef0 0x7fce8019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce80102570 0x7fce80197990 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 --2- 172.21.15.73:0/174700010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce80100e20 0x7fce80197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 >> 172.21.15.73:0/174700010 conn(0x7fce800fc7d0 msgr2=0x7fce800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:43.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 shutdown_connections 2024-09-10T07:59:43.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:43.312+0000 7fce84b7e640 1 -- 172.21.15.73:0/174700010 wait complete. 2024-09-10T07:59:43.355 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a[30846]: 2024-09-10T07:59:43.303+0000 7f5ec268e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:59:43.626 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b[65355]: ignoring --setuser ceph since I am not root 2024-09-10T07:59:43.626 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b[65355]: ignoring --setgroup ceph since I am not root 2024-09-10T07:59:43.626 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-mds[65359]: -- 172.21.15.102:0/3850510207 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558704e17c20 con 0x558704df4800 2024-09-10T07:59:43.626 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b[65355]: starting mds.b at 2024-09-10T07:59:43.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/174700010' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T07:59:43.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-mon[35514]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T07:59:43.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-mon[35514]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:59:43.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/174700010' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T07:59:43.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-mon[35514]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T07:59:43.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-mon[35514]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-10T07:59:43.628 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-h[65048]: ignoring --setuser ceph since I am not root 2024-09-10T07:59:43.628 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-h[65048]: ignoring --setgroup ceph since I am not root 2024-09-10T07:59:43.628 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-mds[65052]: -- 172.21.15.102:0/3527458050 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e8c09f860 con 0x557e8c07d000 2024-09-10T07:59:43.628 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 07:59:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-h[65048]: starting mds.h at 2024-09-10T07:59:43.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:43 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/174700010' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T07:59:43.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:43 smithi159 ceph-mon[35522]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T07:59:43.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:43 smithi159 ceph-mon[35522]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:59:43.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:43 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/174700010' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T07:59:43.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:43 smithi159 ceph-mon[35522]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T07:59:43.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:43 smithi159 ceph-mon[35522]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-10T07:59:43.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:43 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/174700010' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T07:59:43.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:43 smithi073 ceph-mon[30850]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T07:59:43.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:43 smithi073 ceph-mon[30850]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:59:43.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:43 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/174700010' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T07:59:43.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:43 smithi073 ceph-mon[30850]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T07:59:43.670 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:43 smithi073 ceph-mon[30850]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-10T07:59:43.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:59:44.247 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:44.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:44 smithi102 ceph-mon[35514]: pgmap v330: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-10T07:59:44.647 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:44 smithi073 ceph-mon[30850]: pgmap v330: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-10T07:59:44.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:44 smithi159 ceph-mon[35522]: pgmap v330: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-10T07:59:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.671+0000 7f8002841640 1 -- 172.21.15.73:0/18141674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc100a80 msgr2=0x7f7ffc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.671+0000 7f8002841640 1 --2- 172.21.15.73:0/18141674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc100a80 0x7f7ffc100ee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009930 tx=0x7f7ff002a420 comp rx=0 tx=0).stop 2024-09-10T07:59:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.671+0000 7f8002841640 1 -- 172.21.15.73:0/18141674 shutdown_connections 2024-09-10T07:59:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.671+0000 7f8002841640 1 --2- 172.21.15.73:0/18141674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ffc101420 0x7f7ffc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.671+0000 7f8002841640 1 --2- 172.21.15.73:0/18141674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc100a80 0x7f7ffc100ee0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:44.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.671+0000 7f8002841640 1 --2- 172.21.15.73:0/18141674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ffc106a80 0x7f7ffc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:44.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.671+0000 7f8002841640 1 -- 172.21.15.73:0/18141674 >> 172.21.15.73:0/18141674 conn(0x7f7ffc0fc7a0 msgr2=0x7f7ffc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:44.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.671+0000 7f8002841640 1 -- 172.21.15.73:0/18141674 shutdown_connections 2024-09-10T07:59:44.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.671+0000 7f8002841640 1 -- 172.21.15.73:0/18141674 wait complete. 2024-09-10T07:59:44.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.672+0000 7f8002841640 1 Processor -- start 2024-09-10T07:59:44.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.672+0000 7f8002841640 1 -- start start 2024-09-10T07:59:44.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.672+0000 7f8002841640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ffc100a80 0x7f7ffc0fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:44.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.672+0000 7f8002841640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc101420 0x7f7ffc0fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:44.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.672+0000 7f8002841640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ffc106a80 0x7f7ffc0fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:44.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.672+0000 7f8002841640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc110e80 con 0x7f7ffc101420 2024-09-10T07:59:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.672+0000 7f8002841640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc110d00 con 0x7f7ffc106a80 2024-09-10T07:59:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.672+0000 7f8002841640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc111000 con 0x7f7ffc100a80 2024-09-10T07:59:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.672+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc101420 0x7f7ffc0fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc101420 0x7f7ffc0fd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58632/0 (socket says 172.21.15.73:58632) 2024-09-10T07:59:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ffb7fe640 1 -- 172.21.15.73:0/3543134672 learned_addr learned my addr 172.21.15.73:0/3543134672 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f8000dde640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ffc106a80 0x7f7ffc0fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:44.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ffbfff640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ffc100a80 0x7f7ffc0fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ffb7fe640 1 -- 172.21.15.73:0/3543134672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ffc100a80 msgr2=0x7f7ffc0fce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ffb7fe640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ffc100a80 0x7f7ffc0fce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ffb7fe640 1 -- 172.21.15.73:0/3543134672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ffc106a80 msgr2=0x7f7ffc0fd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ffb7fe640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ffc106a80 0x7f7ffc0fd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ffb7fe640 1 -- 172.21.15.73:0/3543134672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc1a6960 con 0x7f7ffc101420 2024-09-10T07:59:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ffb7fe640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc101420 0x7f7ffc0fd390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009230 tx=0x7f7ff0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ff97fa640 1 -- 172.21.15.73:0/3543134672 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff003f030 con 0x7f7ffc101420 2024-09-10T07:59:44.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ff97fa640 1 -- 172.21.15.73:0/3543134672 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ff0003ad0 con 0x7f7ffc101420 2024-09-10T07:59:44.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc1a6bf0 con 0x7f7ffc101420 2024-09-10T07:59:44.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f7ff97fa640 1 -- 172.21.15.73:0/3543134672 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0035070 con 0x7f7ffc101420 2024-09-10T07:59:44.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.673+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc1a70d0 con 0x7f7ffc101420 2024-09-10T07:59:44.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.674+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ffc100ee0 con 0x7f7ffc101420 2024-09-10T07:59:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.675+0000 7f7ff97fa640 1 -- 172.21.15.73:0/3543134672 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7ff0042030 con 0x7f7ffc101420 2024-09-10T07:59:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.676+0000 7f7ff97fa640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f7fe40a2cf0 0x7f7fe40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.676+0000 7f7ffbfff640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f7fe40a2cf0 0x7f7fe40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.676+0000 7f7ff97fa640 1 -- 172.21.15.73:0/3543134672 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8714+0+0 (secure 0 0 0) 0x7f7ff00ef940 con 0x7f7ffc101420 2024-09-10T07:59:44.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.677+0000 7f7ffbfff640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f7fe40a2cf0 0x7f7fe40a51b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00bb60 tx=0x7f7fec00b390 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:44.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.681+0000 7f7ff97fa640 1 -- 172.21.15.73:0/3543134672 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ff00bbe50 con 0x7f7ffc101420 2024-09-10T07:59:44.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:44.893+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7ffc10a000 con 0x7f7ffc101420 2024-09-10T07:59:45.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.374+0000 7f7ff97fa640 1 -- 172.21.15.73:0/3543134672 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7f7ff00c0150 con 0x7f7ffc101420 2024-09-10T07:59:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f7fe40a2cf0 msgr2=0x7f7fe40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f7fe40a2cf0 0x7f7fe40a51b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00bb60 tx=0x7f7fec00b390 comp rx=0 tx=0).stop 2024-09-10T07:59:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc101420 msgr2=0x7f7ffc0fd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc101420 0x7f7ffc0fd390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009230 tx=0x7f7ff0004270 comp rx=0 tx=0).stop 2024-09-10T07:59:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 shutdown_connections 2024-09-10T07:59:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7f7fe40a2cf0 0x7f7fe40a51b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ffc106a80 0x7f7ffc0fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ffc101420 0x7f7ffc0fd390 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 --2- 172.21.15.73:0/3543134672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ffc100a80 0x7f7ffc0fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 >> 172.21.15.73:0/3543134672 conn(0x7f7ffc0fc7a0 msgr2=0x7f7ffc06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 shutdown_connections 2024-09-10T07:59:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:45.376+0000 7f8002841640 1 -- 172.21.15.73:0/3543134672 wait complete. 2024-09-10T07:59:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:45 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.102:6836/3177590547,v1:172.21.15.102:6838/3177590547] up:boot 2024-09-10T07:59:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:45 smithi102 ceph-mon[35514]: mds.? [v2:172.21.15.102:6837/2384729855,v1:172.21.15.102:6839/2384729855] up:boot 2024-09-10T07:59:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:45 smithi102 ceph-mon[35514]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-10T07:59:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:45 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T07:59:45.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:45 smithi102 ceph-mon[35514]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T07:59:45.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:45 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3543134672' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T07:59:45.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:45 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.102:6836/3177590547,v1:172.21.15.102:6838/3177590547] up:boot 2024-09-10T07:59:45.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:45 smithi159 ceph-mon[35522]: mds.? [v2:172.21.15.102:6837/2384729855,v1:172.21.15.102:6839/2384729855] up:boot 2024-09-10T07:59:45.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:45 smithi159 ceph-mon[35522]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-10T07:59:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:45 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T07:59:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:45 smithi159 ceph-mon[35522]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T07:59:45.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:45 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3543134672' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T07:59:45.676 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:45 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.102:6836/3177590547,v1:172.21.15.102:6838/3177590547] up:boot 2024-09-10T07:59:45.676 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:45 smithi073 ceph-mon[30850]: mds.? [v2:172.21.15.102:6837/2384729855,v1:172.21.15.102:6839/2384729855] up:boot 2024-09-10T07:59:45.676 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:45 smithi073 ceph-mon[30850]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-10T07:59:45.676 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:45 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T07:59:45.676 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:45 smithi073 ceph-mon[30850]: from='mgr.15066 172.21.15.73:0/2219935224' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T07:59:45.676 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:45 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3543134672' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T07:59:46.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:59:46.295 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:46.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:46 smithi102 ceph-mon[35514]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T07:59:46.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:46 smithi102 ceph-mon[35514]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T07:59:46.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:46 smithi102 ceph-mon[35514]: Cluster is now healthy 2024-09-10T07:59:46.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:46 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/3543134672' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T07:59:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:46 smithi102 ceph-mon[35514]: fsmap 12 up:standby 2024-09-10T07:59:46.627 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:46 smithi102 ceph-mon[35514]: pgmap v331: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-10T07:59:46.647 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:46 smithi073 ceph-mon[30850]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T07:59:46.647 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:46 smithi073 ceph-mon[30850]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T07:59:46.647 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:46 smithi073 ceph-mon[30850]: Cluster is now healthy 2024-09-10T07:59:46.647 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:46 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/3543134672' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T07:59:46.647 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:46 smithi073 ceph-mon[30850]: fsmap 12 up:standby 2024-09-10T07:59:46.648 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:46 smithi073 ceph-mon[30850]: pgmap v331: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-10T07:59:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:46 smithi159 ceph-mon[35522]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T07:59:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:46 smithi159 ceph-mon[35522]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T07:59:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:46 smithi159 ceph-mon[35522]: Cluster is now healthy 2024-09-10T07:59:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:46 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/3543134672' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T07:59:46.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:46 smithi159 ceph-mon[35522]: fsmap 12 up:standby 2024-09-10T07:59:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:46 smithi159 ceph-mon[35522]: pgmap v331: 97 pgs: 97 active+clean; 13 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-10T07:59:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 -- 172.21.15.73:0/4255505406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 msgr2=0x7fedd4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/4255505406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 0x7fedd4101200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009900 tx=0x7fedc402a480 comp rx=0 tx=0).stop 2024-09-10T07:59:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 -- 172.21.15.73:0/4255505406 shutdown_connections 2024-09-10T07:59:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/4255505406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedd4102ef0 0x7fedd410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/4255505406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd4102570 0x7fedd41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/4255505406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 0x7fedd4101200 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 -- 172.21.15.73:0/4255505406 >> 172.21.15.73:0/4255505406 conn(0x7fedd40fc7d0 msgr2=0x7fedd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 -- 172.21.15.73:0/4255505406 shutdown_connections 2024-09-10T07:59:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 -- 172.21.15.73:0/4255505406 wait complete. 2024-09-10T07:59:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.733+0000 7fedd9dc4640 1 Processor -- start 2024-09-10T07:59:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd9dc4640 1 -- start start 2024-09-10T07:59:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd9dc4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 0x7fedd4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd9dc4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd4102570 0x7fedd4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd9dc4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedd4102ef0 0x7fedd41a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd9dc4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4110f80 con 0x7fedd4100e20 2024-09-10T07:59:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd9dc4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4110e00 con 0x7fedd4102570 2024-09-10T07:59:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd9dc4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4111100 con 0x7fedd4102ef0 2024-09-10T07:59:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 0x7fedd4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 0x7fedd4199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58662/0 (socket says 172.21.15.73:58662) 2024-09-10T07:59:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd37fe640 1 -- 172.21.15.73:0/148725819 learned_addr learned my addr 172.21.15.73:0/148725819 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd3fff640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedd4102ef0 0x7fedd41a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedcbfff640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd4102570 0x7fedd4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd37fe640 1 -- 172.21.15.73:0/148725819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedd4102ef0 msgr2=0x7fedd41a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd37fe640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedd4102ef0 0x7fedd41a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd37fe640 1 -- 172.21.15.73:0/148725819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd4102570 msgr2=0x7fedd4199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd37fe640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd4102570 0x7fedd4199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd37fe640 1 -- 172.21.15.73:0/148725819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd41a48c0 con 0x7fedd4100e20 2024-09-10T07:59:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.734+0000 7fedd37fe640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 0x7fedd4199300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fedc4006010 tx=0x7fedc4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.735+0000 7fedd17fa640 1 -- 172.21.15.73:0/148725819 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc403f070 con 0x7fedd4100e20 2024-09-10T07:59:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.735+0000 7fedd17fa640 1 -- 172.21.15.73:0/148725819 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedc4031c30 con 0x7fedd4100e20 2024-09-10T07:59:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.735+0000 7fedd17fa640 1 -- 172.21.15.73:0/148725819 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4035030 con 0x7fedd4100e20 2024-09-10T07:59:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.735+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd41a4a90 con 0x7fedd4100e20 2024-09-10T07:59:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.735+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd41a4f40 con 0x7fedd4100e20 2024-09-10T07:59:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.736+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd4101200 con 0x7fedd4100e20 2024-09-10T07:59:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.737+0000 7fedd17fa640 1 -- 172.21.15.73:0/148725819 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fedc4042070 con 0x7fedd4100e20 2024-09-10T07:59:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.737+0000 7fedd17fa640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fedc00a2d70 0x7fedc00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.737+0000 7fedcbfff640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fedc00a2d70 0x7fedc00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.737+0000 7fedd17fa640 1 -- 172.21.15.73:0/148725819 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8714+0+0 (secure 0 0 0) 0x7fedc40efaf0 con 0x7fedd4100e20 2024-09-10T07:59:46.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.738+0000 7fedcbfff640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fedc00a2d70 0x7fedc00a5230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fedd406aac0 tx=0x7fedbc00b410 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:46.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.742+0000 7fedd17fa640 1 -- 172.21.15.73:0/148725819 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fedc40bc000 con 0x7fedd4100e20 2024-09-10T07:59:46.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:46.930+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fedd4109090 con 0x7fedd4100e20 2024-09-10T07:59:47.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.385+0000 7fedd17fa640 1 -- 172.21.15.73:0/148725819 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) ==== 181+0+0 (secure 0 0 0) 0x7fedc40c0300 con 0x7fedd4100e20 2024-09-10T07:59:47.384 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:59:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fedc00a2d70 msgr2=0x7fedc00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fedc00a2d70 0x7fedc00a5230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fedd406aac0 tx=0x7fedbc00b410 comp rx=0 tx=0).stop 2024-09-10T07:59:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 msgr2=0x7fedd4199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 0x7fedd4199300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fedc4006010 tx=0x7fedc4003c10 comp rx=0 tx=0).stop 2024-09-10T07:59:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 shutdown_connections 2024-09-10T07:59:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7fedc00a2d70 0x7fedc00a5230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedd4102ef0 0x7fedd41a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd4102570 0x7fedd4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:47.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 --2- 172.21.15.73:0/148725819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedd4100e20 0x7fedd4199300 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:47.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.388+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 >> 172.21.15.73:0/148725819 conn(0x7fedd40fc7d0 msgr2=0x7fedd40fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:47.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.389+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 shutdown_connections 2024-09-10T07:59:47.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:47.389+0000 7fedd9dc4640 1 -- 172.21.15.73:0/148725819 wait complete. 2024-09-10T07:59:47.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:47 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/148725819' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T07:59:47.676 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:47 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/148725819' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T07:59:47.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:47 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/148725819' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T07:59:48.114 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid c025e280-6f47-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:59:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T07:59:48.649 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:48 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/148725819' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T07:59:48.649 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:48 smithi073 ceph-mon[30850]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T07:59:48.649 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:48 smithi073 ceph-mon[30850]: pgmap v333: 65 pgs: 65 active+clean; 13 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail 2024-09-10T07:59:48.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:48 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/148725819' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T07:59:48.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:48 smithi159 ceph-mon[35522]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T07:59:48.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:48 smithi159 ceph-mon[35522]: pgmap v333: 65 pgs: 65 active+clean; 13 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail 2024-09-10T07:59:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.841+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1073191105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff994101df0 msgr2=0x7ff9941021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.841+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1073191105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff994101df0 0x7ff9941021d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff990009900 tx=0x7ff99002a410 comp rx=0 tx=0).stop 2024-09-10T07:59:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.841+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1073191105 shutdown_connections 2024-09-10T07:59:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.841+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1073191105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994106f20 0x7ff99410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.841+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1073191105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9941027a0 0x7ff9941067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.841+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1073191105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff994101df0 0x7ff9941021d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.841+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1073191105 >> 172.21.15.73:0/1073191105 conn(0x7ff9940fd8f0 msgr2=0x7ff9940ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.841+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1073191105 shutdown_connections 2024-09-10T07:59:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.841+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1073191105 wait complete. 2024-09-10T07:59:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99bcaf640 1 Processor -- start 2024-09-10T07:59:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99bcaf640 1 -- start start 2024-09-10T07:59:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99bcaf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff994101df0 0x7ff9940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99bcaf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99bcaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994106f20 0x7ff994074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99bcaf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff994111f40 con 0x7ff9941027a0 2024-09-10T07:59:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99bcaf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff994111dc0 con 0x7ff994106f20 2024-09-10T07:59:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99bcaf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff9941120c0 con 0x7ff994101df0 2024-09-10T07:59:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99924a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99a24c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994106f20 0x7ff994074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.842+0000 7ff99924a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58682/0 (socket says 172.21.15.73:58682) 2024-09-10T07:59:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99924a640 1 -- 172.21.15.73:0/1552686233 learned_addr learned my addr 172.21.15.73:0/1552686233 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-10T07:59:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff999a4b640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff994101df0 0x7ff9940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99a24c640 1 -- 172.21.15.73:0/1552686233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff994101df0 msgr2=0x7ff9940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99a24c640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff994101df0 0x7ff9940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99a24c640 1 -- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941027a0 msgr2=0x7ff994074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99a24c640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99a24c640 1 -- 172.21.15.73:0/1552686233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9941a68a0 con 0x7ff994106f20 2024-09-10T07:59:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99924a640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:59:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99a24c640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994106f20 0x7ff994074f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009fd0 tx=0x7ff98c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff98affd640 1 -- 172.21.15.73:0/1552686233 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00ce20 con 0x7ff994106f20 2024-09-10T07:59:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff98affd640 1 -- 172.21.15.73:0/1552686233 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff98c005020 con 0x7ff994106f20 2024-09-10T07:59:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9941a6b90 con 0x7ff994106f20 2024-09-10T07:59:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff98affd640 1 -- 172.21.15.73:0/1552686233 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c010720 con 0x7ff994106f20 2024-09-10T07:59:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.843+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9941a7080 con 0x7ff994106f20 2024-09-10T07:59:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.844+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9941021d0 con 0x7ff994106f20 2024-09-10T07:59:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.845+0000 7ff98affd640 1 -- 172.21.15.73:0/1552686233 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff98c005540 con 0x7ff994106f20 2024-09-10T07:59:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.846+0000 7ff98affd640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff9800a2cf0 0x7ff9800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.846+0000 7ff999a4b640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff9800a2cf0 0x7ff9800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.846+0000 7ff98affd640 1 -- 172.21.15.73:0/1552686233 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8160+0+0 (secure 0 0 0) 0x7ff98c0cfa70 con 0x7ff994106f20 2024-09-10T07:59:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.846+0000 7ff999a4b640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff9800a2cf0 0x7ff9800a51b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff990009230 tx=0x7ff9900058d0 comp rx=0 tx=0).ready entity=mgr.15066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:48.849+0000 7ff98affd640 1 -- 172.21.15.73:0/1552686233 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff98c09c7d0 con 0x7ff994106f20 2024-09-10T07:59:48.875 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:48 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/148725819' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T07:59:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:48 smithi102 ceph-mon[35514]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T07:59:48.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:48 smithi102 ceph-mon[35514]: pgmap v333: 65 pgs: 65 active+clean; 13 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail 2024-09-10T07:59:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.021+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff994075a20 con 0x7ff994106f20 2024-09-10T07:59:49.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.415+0000 7ff98affd640 1 -- 172.21.15.73:0/1552686233 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) ==== 169+0+0 (secure 0 0 0) 0x7ff994075a20 con 0x7ff994106f20 2024-09-10T07:59:49.415 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-10T07:59:49.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff9800a2cf0 msgr2=0x7ff9800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:49.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff9800a2cf0 0x7ff9800a51b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff990009230 tx=0x7ff9900058d0 comp rx=0 tx=0).stop 2024-09-10T07:59:49.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994106f20 msgr2=0x7ff994074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:49.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994106f20 0x7ff994074f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009fd0 tx=0x7ff98c00ef10 comp rx=0 tx=0).stop 2024-09-10T07:59:49.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 shutdown_connections 2024-09-10T07:59:49.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:6800/3122839464,v1:172.21.15.73:6801/3122839464] conn(0x7ff9800a2cf0 0x7ff9800a51b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:49.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994106f20 0x7ff994074f70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:49.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:49.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 --2- 172.21.15.73:0/1552686233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff994101df0 0x7ff9940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:49.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 >> 172.21.15.73:0/1552686233 conn(0x7ff9940fd8f0 msgr2=0x7ff9940fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:49.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 shutdown_connections 2024-09-10T07:59:49.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-10T07:59:49.419+0000 7ff99bcaf640 1 -- 172.21.15.73:0/1552686233 wait complete. 2024-09-10T07:59:49.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:49 smithi159 ceph-mon[35522]: from='client.? 172.21.15.73:0/1552686233' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T07:59:49.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:49 smithi159 ceph-mon[35522]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T07:59:49.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:49 smithi073 ceph-mon[30850]: from='client.? 172.21.15.73:0/1552686233' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T07:59:49.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:49 smithi073 ceph-mon[30850]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T07:59:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:49 smithi102 ceph-mon[35514]: from='client.? 172.21.15.73:0/1552686233' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T07:59:49.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:49 smithi102 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T07:59:50.087 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T07:59:50.128 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T07:59:50.168 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T07:59:50.207 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T07:59:50.207 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T07:59:50.229 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T07:59:50.251 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T07:59:50.273 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T07:59:50.274 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T07:59:50.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.a 2024-09-10T07:59:50.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:50 smithi159 ceph-mon[35522]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T07:59:50.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:50 smithi159 ceph-mon[35522]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T07:59:50.657 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:50 smithi159 ceph-mon[35522]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 74 GiB used, 999 GiB / 1.0 TiB avail 2024-09-10T07:59:50.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:50 smithi073 systemd[1]: Stopping Ceph mon.a for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:59:50.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:50 smithi073 ceph-mon[30850]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T07:59:50.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:50 smithi073 ceph-mon[30850]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T07:59:50.722 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:50 smithi073 ceph-mon[30850]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 74 GiB used, 999 GiB / 1.0 TiB avail 2024-09-10T07:59:50.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:50 smithi102 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T07:59:50.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:50 smithi102 ceph-mon[35514]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T07:59:50.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:50 smithi102 ceph-mon[35514]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 74 GiB used, 999 GiB / 1.0 TiB avail 2024-09-10T07:59:51.153 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a[30846]: 2024-09-10T07:59:50.815+0000 7f5ec7e99640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T07:59:51.154 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a[30846]: 2024-09-10T07:59:50.815+0000 7f5ec7e99640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T07:59:51.154 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:50 smithi073 podman[91174]: 2024-09-10 07:59:50.939841724 +0000 UTC m=+0.275144419 container died ef87ed974fd010627cdb48ed588e1eb9de4385a0d3c4454b90c13121e1dae6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:59:51.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:51 smithi073 podman[91174]: 2024-09-10 07:59:51.364444438 +0000 UTC m=+0.699747132 container cleanup ef87ed974fd010627cdb48ed588e1eb9de4385a0d3c4454b90c13121e1dae6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:59:51.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:51 smithi073 bash[91174]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a 2024-09-10T07:59:51.972 INFO:journalctl@ceph.mon.a.smithi073.stdout:Sep 10 07:59:51 smithi073 podman[91185]: 2024-09-10 07:59:51.641020894 +0000 UTC m=+0.691332220 container remove ef87ed974fd010627cdb48ed588e1eb9de4385a0d3c4454b90c13121e1dae6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:59:52.193 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T07:59:52.268 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T07:59:52.268 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T07:59:52.268 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T07:59:52.269 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.b 2024-09-10T07:59:52.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:52 smithi102 systemd[1]: Stopping Ceph mon.b for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:59:53.166 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-b[35510]: 2024-09-10T07:59:52.918+0000 7fc10ec76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T07:59:53.166 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-b[35510]: 2024-09-10T07:59:52.918+0000 7fc10ec76640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T07:59:53.604 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:53 smithi102 podman[70562]: 2024-09-10 07:59:53.167245512 +0000 UTC m=+0.445329139 container died b718932ee7244807a0aa0d436ab569d971f50514274e4bb00eba86f37fa01bd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-b, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T07:59:53.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:53 smithi102 podman[70562]: 2024-09-10 07:59:53.60524621 +0000 UTC m=+0.883329832 container cleanup b718932ee7244807a0aa0d436ab569d971f50514274e4bb00eba86f37fa01bd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T07:59:53.876 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:53 smithi102 bash[70562]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-b 2024-09-10T07:59:54.358 INFO:journalctl@ceph.mon.b.smithi102.stdout:Sep 10 07:59:53 smithi102 podman[70573]: 2024-09-10 07:59:53.890037952 +0000 UTC m=+0.705831647 container remove b718932ee7244807a0aa0d436ab569d971f50514274e4bb00eba86f37fa01bd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T07:59:54.376 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T07:59:54.447 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T07:59:54.448 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T07:59:54.448 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T07:59:54.448 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.c 2024-09-10T07:59:54.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:54 smithi159 systemd[1]: Stopping Ceph mon.c for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:59:55.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-c[35518]: 2024-09-10T07:59:55.093+0000 7f5ee830a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T07:59:55.407 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-c[35518]: 2024-09-10T07:59:55.093+0000 7f5ee830a640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T07:59:55.408 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:55 smithi159 podman[71140]: 2024-09-10 07:59:55.255517006 +0000 UTC m=+0.421542367 container died d3abba75b6d82f134674250bcc469af4f1de1ee8fdda23bf99c858c2bfaa97a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-c, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T07:59:55.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:55 smithi159 podman[71140]: 2024-09-10 07:59:55.750537595 +0000 UTC m=+0.916562945 container cleanup d3abba75b6d82f134674250bcc469af4f1de1ee8fdda23bf99c858c2bfaa97a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T07:59:55.907 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 10 07:59:55 smithi159 bash[71140]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mon-c 2024-09-10T07:59:56.240 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T07:59:56.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T07:59:56.290 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T07:59:56.290 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T07:59:56.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.x 2024-09-10T07:59:56.618 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:59:56 smithi073 systemd[1]: Stopping Ceph mgr.x for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:59:56.919 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:59:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:59:56.618+0000 7f3bef08d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T07:59:56.919 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:59:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x[31073]: 2024-09-10T07:59:56.618+0000 7f3bef08d640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-10T07:59:56.920 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:59:56 smithi073 podman[91282]: 2024-09-10 07:59:56.650314115 +0000 UTC m=+0.142596033 container died 196638ff18915bf5ef5ed052c73608191da0e6a7b0ab1dc9afaa6462d23d4b99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T07:59:57.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:59:57 smithi073 podman[91282]: 2024-09-10 07:59:57.04482079 +0000 UTC m=+0.537102705 container cleanup 196638ff18915bf5ef5ed052c73608191da0e6a7b0ab1dc9afaa6462d23d4b99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T07:59:57.222 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Sep 10 07:59:57 smithi073 bash[91282]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-x 2024-09-10T07:59:57.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T07:59:57.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T07:59:57.489 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T07:59:57.490 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T07:59:57.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.y 2024-09-10T07:59:57.806 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:59:57 smithi102 systemd[1]: Stopping Ceph mgr.y for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:59:58.109 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:59:57 smithi102 podman[70672]: 2024-09-10 07:59:57.837725145 +0000 UTC m=+0.164142563 container died 42f4375eb869cc5eee649b4962a51d2626d327c21f4d0dcddfbbc8aad0857593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T07:59:58.376 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:59:58 smithi102 podman[70672]: 2024-09-10 07:59:58.193194968 +0000 UTC m=+0.519612383 container cleanup 42f4375eb869cc5eee649b4962a51d2626d327c21f4d0dcddfbbc8aad0857593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T07:59:58.376 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Sep 10 07:59:58 smithi102 bash[70672]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-y 2024-09-10T07:59:58.630 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T07:59:58.664 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T07:59:58.664 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T07:59:58.664 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T07:59:58.665 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.z 2024-09-10T07:59:58.940 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:59:58 smithi159 systemd[1]: Stopping Ceph mgr.z for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T07:59:59.406 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:59:59 smithi159 podman[71270]: 2024-09-10 07:59:59.112196761 +0000 UTC m=+0.242616727 container died 5f1653ae19b5bd080f2cbec21ce84898748cfde94fa9da92327bd229bece17b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T07:59:59.657 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:59:59 smithi159 podman[71270]: 2024-09-10 07:59:59.489232707 +0000 UTC m=+0.619652662 container cleanup 5f1653ae19b5bd080f2cbec21ce84898748cfde94fa9da92327bd229bece17b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T07:59:59.657 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 10 07:59:59 smithi159 bash[71270]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mgr-z 2024-09-10T07:59:59.916 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T07:59:59.954 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T07:59:59.954 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T07:59:59.954 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T07:59:59.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.0 2024-09-10T08:00:00.257 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 07:59:59 smithi073 systemd[1]: Stopping Ceph osd.0 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:00:00.722 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0[44970]: 2024-09-10T08:00:00.257+0000 7f959c2d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:00:00.722 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0[44970]: 2024-09-10T08:00:00.257+0000 7f959c2d5640 -1 osd.0 97 *** Got signal Terminated *** 2024-09-10T08:00:00.722 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0[44970]: 2024-09-10T08:00:00.257+0000 7f959c2d5640 -1 osd.0 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:00:30.615 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:30 smithi073 bash[91403]: time="2024-09-10T08:00:30Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0 in 30 seconds, resorting to SIGKILL" 2024-09-10T08:00:30.616 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:30 smithi073 podman[91403]: 2024-09-10 08:00:30.370237842 +0000 UTC m=+30.227080936 container died b69e0fb466f18dc91cf3b5b0287c4d06e0f40db5195f01466d9aa9a38f739cfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:00:30.939 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:30 smithi073 podman[91403]: 2024-09-10 08:00:30.698224224 +0000 UTC m=+30.555067304 container cleanup b69e0fb466f18dc91cf3b5b0287c4d06e0f40db5195f01466d9aa9a38f739cfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T08:00:30.939 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:30 smithi073 bash[91403]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0 2024-09-10T08:00:31.222 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:30 smithi073 podman[91426]: 2024-09-10 08:00:30.941212504 +0000 UTC m=+0.565228429 container remove b69e0fb466f18dc91cf3b5b0287c4d06e0f40db5195f01466d9aa9a38f739cfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T08:00:31.222 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:30 smithi073 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.0.service: Main process exited, code=exited, status=137/n/a 2024-09-10T08:00:31.701 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:31 smithi073 podman[91510]: 2024-09-10 08:00:31.272195785 +0000 UTC m=+0.015611756 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:00:31.702 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:31 smithi073 podman[91510]: 2024-09-10 08:00:31.467144273 +0000 UTC m=+0.210560281 container create 952e81504c2ec86a27d996908e22b5f8699bd157df2835aacef63a221aa84fda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:00:31.702 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:31 smithi073 podman[91510]: 2024-09-10 08:00:31.703067313 +0000 UTC m=+0.446483280 container init 952e81504c2ec86a27d996908e22b5f8699bd157df2835aacef63a221aa84fda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T08:00:31.972 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:31 smithi073 podman[91510]: 2024-09-10 08:00:31.706543331 +0000 UTC m=+0.449959303 container start 952e81504c2ec86a27d996908e22b5f8699bd157df2835aacef63a221aa84fda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T08:00:31.973 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:31 smithi073 podman[91510]: 2024-09-10 08:00:31.786296706 +0000 UTC m=+0.529712670 container attach 952e81504c2ec86a27d996908e22b5f8699bd157df2835aacef63a221aa84fda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:00:31.973 INFO:journalctl@ceph.osd.0.smithi073.stdout:Sep 10 08:00:31 smithi073 podman[91510]: 2024-09-10 08:00:31.945176367 +0000 UTC m=+0.688592334 container died 952e81504c2ec86a27d996908e22b5f8699bd157df2835aacef63a221aa84fda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T08:00:32.451 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T08:00:32.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:00:32.491 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T08:00:32.491 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T08:00:32.491 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.1 2024-09-10T08:00:32.787 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:00:32 smithi102 systemd[1]: Stopping Ceph osd.1 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:00:33.126 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:00:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1[40020]: 2024-09-10T08:00:32.787+0000 7fb946a50640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:00:33.126 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:00:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1[40020]: 2024-09-10T08:00:32.787+0000 7fb946a50640 -1 osd.1 97 *** Got signal Terminated *** 2024-09-10T08:00:33.126 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:00:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1[40020]: 2024-09-10T08:00:32.787+0000 7fb946a50640 -1 osd.1 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:01:03.127 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:02 smithi102 bash[70795]: time="2024-09-10T08:01:02Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1 in 30 seconds, resorting to SIGKILL" 2024-09-10T08:01:03.128 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:02 smithi102 podman[70795]: 2024-09-10 08:01:02.923525265 +0000 UTC m=+30.240455231 container died 6fc2544df2fec8e76b1503340608a327c1cb5f82ee52e61785f63d6230adb34d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T08:01:03.613 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:03 smithi102 podman[70795]: 2024-09-10 08:01:03.320496478 +0000 UTC m=+30.637426429 container cleanup 6fc2544df2fec8e76b1503340608a327c1cb5f82ee52e61785f63d6230adb34d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T08:01:03.613 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:03 smithi102 bash[70795]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1 2024-09-10T08:01:03.876 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:03 smithi102 podman[70839]: 2024-09-10 08:01:03.61370284 +0000 UTC m=+0.688031854 container remove 6fc2544df2fec8e76b1503340608a327c1cb5f82ee52e61785f63d6230adb34d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T08:01:03.876 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:03 smithi102 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.1.service: Main process exited, code=exited, status=137/n/a 2024-09-10T08:01:04.215 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:03 smithi102 podman[70929]: 2024-09-10 08:01:03.931053985 +0000 UTC m=+0.109986556 container create 371d2a7f09407bdd0a08a2ea35f1d2154d4a8b9a06b64866088addafd618311f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T08:01:04.215 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:03 smithi102 podman[70929]: 2024-09-10 08:01:03.836872054 +0000 UTC m=+0.015804627 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:01:04.216 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:04 smithi102 podman[70929]: 2024-09-10 08:01:04.141865478 +0000 UTC m=+0.320798053 container init 371d2a7f09407bdd0a08a2ea35f1d2154d4a8b9a06b64866088addafd618311f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T08:01:04.216 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:04 smithi102 podman[70929]: 2024-09-10 08:01:04.145675017 +0000 UTC m=+0.324607590 container start 371d2a7f09407bdd0a08a2ea35f1d2154d4a8b9a06b64866088addafd618311f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-10T08:01:04.216 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:04 smithi102 podman[70929]: 2024-09-10 08:01:04.216689575 +0000 UTC m=+0.395622162 container attach 371d2a7f09407bdd0a08a2ea35f1d2154d4a8b9a06b64866088addafd618311f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-10T08:01:04.626 INFO:journalctl@ceph.osd.1.smithi102.stdout:Sep 10 08:01:04 smithi102 podman[70929]: 2024-09-10 08:01:04.347027292 +0000 UTC m=+0.525959865 container died 371d2a7f09407bdd0a08a2ea35f1d2154d4a8b9a06b64866088addafd618311f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T08:01:04.923 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T08:01:04.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:01:04.961 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T08:01:04.962 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T08:01:04.962 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.2 2024-09-10T08:01:05.348 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:05 smithi159 systemd[1]: Stopping Ceph osd.2 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:01:05.657 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2[40503]: 2024-09-10T08:01:05.348+0000 7f33a14bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:01:05.657 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2[40503]: 2024-09-10T08:01:05.348+0000 7f33a14bd640 -1 osd.2 97 *** Got signal Terminated *** 2024-09-10T08:01:05.657 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2[40503]: 2024-09-10T08:01:05.348+0000 7f33a14bd640 -1 osd.2 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:01:32.158 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:31.811+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:32.159 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:32.061+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:32.569 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:32.222+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:32.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:32 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:32.273+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:33.054 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:32.800+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:33.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:33.054+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:33.575 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:33 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:33.220+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:33.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:33.304+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:33.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:33.245+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:34.084 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:33.794+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:34.211 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:33.784+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:34.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:34.084+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:34.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:34.212+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:34.473 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:34.343+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:34.625 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:34 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:34.216+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:35.119 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:34.761+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:35.165 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:34.769+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:35.407 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:35 smithi159 bash[71424]: time="2024-09-10T08:01:35Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2 in 30 seconds, resorting to SIGKILL" 2024-09-10T08:01:35.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:35.120+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:35.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:35.165+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:35.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:35.327+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:35.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:35 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:35.239+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:35.721 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:35 smithi159 podman[71424]: 2024-09-10 08:01:35.454690241 +0000 UTC m=+30.296384157 container died ddbdd9a766ad48997b422f6c3314b3258ff25f0df49ac2b4d183f00d5f6f2568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T08:01:36.086 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:35.729+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:36.086 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:35 smithi159 podman[71424]: 2024-09-10 08:01:35.813200615 +0000 UTC m=+30.654894518 container cleanup ddbdd9a766ad48997b422f6c3314b3258ff25f0df49ac2b4d183f00d5f6f2568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:01:36.086 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:35 smithi159 bash[71424]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2 2024-09-10T08:01:36.187 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:35.747+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:36.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:36.086+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:36.408 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:36 smithi159 podman[71457]: 2024-09-10 08:01:36.106596004 +0000 UTC m=+0.647847602 container remove ddbdd9a766ad48997b422f6c3314b3258ff25f0df49ac2b4d183f00d5f6f2568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:01:36.408 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:36 smithi159 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.2.service: Main process exited, code=exited, status=137/n/a 2024-09-10T08:01:36.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:36.187+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:36.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:36.294+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:36.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:36.214+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:36.686 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:36 smithi159 podman[71541]: 2024-09-10 08:01:36.321070713 +0000 UTC m=+0.015985299 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:01:36.686 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:36 smithi159 podman[71541]: 2024-09-10 08:01:36.434207208 +0000 UTC m=+0.129121773 container create 596c009239daea05e006629926a5aab80ca034c30550a6904ddd0f42d6b2cb84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T08:01:37.096 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:36.686+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:37.097 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:36 smithi159 podman[71541]: 2024-09-10 08:01:36.693123485 +0000 UTC m=+0.388038053 container init 596c009239daea05e006629926a5aab80ca034c30550a6904ddd0f42d6b2cb84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T08:01:37.097 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:36 smithi159 podman[71541]: 2024-09-10 08:01:36.696394475 +0000 UTC m=+0.391309041 container start 596c009239daea05e006629926a5aab80ca034c30550a6904ddd0f42d6b2cb84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T08:01:37.097 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:36 smithi159 podman[71541]: 2024-09-10 08:01:36.768161199 +0000 UTC m=+0.463075781 container attach 596c009239daea05e006629926a5aab80ca034c30550a6904ddd0f42d6b2cb84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T08:01:37.097 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 10 08:01:36 smithi159 podman[71541]: 2024-09-10 08:01:36.901573615 +0000 UTC m=+0.596488195 container died 596c009239daea05e006629926a5aab80ca034c30550a6904ddd0f42d6b2cb84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T08:01:37.187 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:36.789+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:37.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:37.096+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:37.456 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T08:01:37.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:37.188+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:37.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:37.306+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:37.495 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:01:37.495 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T08:01:37.496 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T08:01:37.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.3 2024-09-10T08:01:37.625 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:37 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:37.167+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:37.778 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:37 smithi073 systemd[1]: Stopping Ceph osd.3 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:01:37.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:37.654+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:38.181 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:37.778+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:38.181 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:37.973+0000 7f15c2b69640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:01:38.181 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:37.973+0000 7f15c2b69640 -1 osd.3 97 *** Got signal Terminated *** 2024-09-10T08:01:38.182 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:37.973+0000 7f15c2b69640 -1 osd.3 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:01:38.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:38.109+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:38.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:38.182+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:38.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:38.266+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:38.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:38.146+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:39.079 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:38.690+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:39.221 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:38.827+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:39.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:39.080+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:39.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:39.221+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:39.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:39.240+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:39.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:39.132+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:40.115 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:39.735+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:40.222 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:39.805+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:40.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:40.126+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:40.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:40.115+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:40.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:40.248+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:40.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:40.226+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:41.113 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:40.744+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:41.210 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:40.816+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:41.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:41.113+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:41.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:41.274+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:41.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:41.211+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:41.625 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:41.129+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:42.106 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:41.742+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:42.202 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:41.773+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:42.375 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:42.087+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:42.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:42.106+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:42.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:42.203+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:42.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:42.271+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:43.102 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:42.708+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:43.222 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:01:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3[51913]: 2024-09-10T08:01:42.756+0000 7f15bf16e640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.163596+0000 front 2024-09-10T08:00:05.163614+0000 (oldest deadline 2024-09-10T08:01:33.167064+0000) 2024-09-10T08:01:43.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:43.077+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:43.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:43.102+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:43.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:43.313+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:43.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:43.243+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:44.115 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:43.724+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:44.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:44.122+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:44.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:44.115+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:44.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:44.256+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:44.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:44.332+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:44.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:44.749+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:45.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:45.102+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:45.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:45.070+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:45.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:45.346+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:45.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:45.288+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:46.051 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:45.699+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:46.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:46.067+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:46.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:46.052+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:46.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:46.313+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:46.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:46.327+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:47.019 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:46.712+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:47.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:47.108+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:47.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:47.019+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:47.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:47.267+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:47.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:47.373+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:48.060 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:47.684+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:48.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:48.061+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:48.625 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:48.150+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:48.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:48.401+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:48.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:48.315+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:49.094 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:48.706+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:49.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:49.095+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:49.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:49.152+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:49.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:49.339+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:49.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:49.425+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:50.080 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:49.707+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:50.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:50.081+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:50.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:50.171+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:50.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:50.379+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:50.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:50.383+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:51.074 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:50.700+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:51.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:51.074+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:51.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:51.163+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:51.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:51.332+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:51.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:51.379+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:52.111 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:51.741+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:52.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:52.111+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:52.625 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:52.204+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:52.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:52.295+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:52.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:52.338+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:53.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:52.724+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:53.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:53.229+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:53.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:53.160+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:53.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:53.303+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:53.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:53.358+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:54.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:53.748+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:54.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:54.203+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:54.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:54.179+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:54.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:54.352+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:54.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:54.378+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:55.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:54.715+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:55.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:55.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:55.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:55.180+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:55.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:55.375+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:55.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:55.377+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:56.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:55.759+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:56.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:56.162+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:56.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:56.184+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:56.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:56.364+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:56.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:56.378+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:57.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:56.782+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:57.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:57.130+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:57.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:57.196+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:57.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:57.326+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:57.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:57.418+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:58.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:57.756+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:58.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:58.150+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:58.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:58.226+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:58.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:58.337+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:58.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:58.435+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:01:59.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:58.748+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:01:59.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:01:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:01:59.175+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:01:59.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:01:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:01:59.260+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:01:59.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:01:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:01:59.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:01:59.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:01:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:01:59.402+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:00.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:01:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:01:59.752+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:00.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:00.184+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:00.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:00.212+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:00.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:00.387+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:00.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:00.412+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:01.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:00.795+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:01.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:01.214+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:01.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:01.188+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:01.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:01.384+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:01.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:01.372+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:02.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:01.802+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:02.444 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:02.188+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:02.527 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:02.228+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:02.623 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:02.359+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:02.624 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:02.328+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:03.160 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:02.793+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:03.438 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:03.159+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:03.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:03.186+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:03.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:03.361+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:03.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:03.356+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:04.148 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:03.775+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:04.148 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:03.775+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:04.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:03.941+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:04.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:04.140+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:04.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:04.148+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:04.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:04.392+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:04.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:04.392+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:04.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:04.357+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:04.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:04.357+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:05.106 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:04.796+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:05.106 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:04.990+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:05.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:04.755+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:05.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:04.755+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:05.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:05.106+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:05.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:05.106+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:05.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:05.176+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:05.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:05.374+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:05.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:05.374+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:05.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:05.361+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:05.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:05.361+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:06.126 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:05.808+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:06.126 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:06.037+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:06.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:05.825+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:06.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:05.750+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:06.158 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:05.750+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:06.628 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:06.127+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:06.629 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:06.127+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:06.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:06.220+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:06.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:06.220+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:06.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:06.344+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:06.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:06.345+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:06.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:06.317+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:06.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:06.317+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:07.102 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:06.837+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:07.102 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:07.057+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:07.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:06.783+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:07.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:06.780+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:07.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:06.780+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:07.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:07.102+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:07.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:07.102+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:07.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:07.217+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:07.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:07.217+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:07.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:07.390+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:07.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:07.390+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:07.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:07.349+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:07.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:07.349+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:08.095 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:07.835+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:08.095 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:08.073+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:08.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:07.768+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:08.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:07.755+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:08.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:07.755+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:08.314 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:07 smithi073 bash[91654]: time="2024-09-10T08:02:07Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3 in 30 seconds, resorting to SIGKILL" 2024-09-10T08:02:08.314 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:08 smithi073 podman[91654]: 2024-09-10 08:02:08.089250844 +0000 UTC m=+30.385838161 container died 194a011cca7e9977123cdd392da0650080461e43ac34f3af88070e1e241f03c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T08:02:08.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:08.096+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:08.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:08.096+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:08.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:08.169+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:08.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:08.169+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:08.691 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:08.433+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:08.692 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:08.433+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:08.692 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:08.314+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:08.692 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:08.314+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:08.693 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:08 smithi073 podman[91654]: 2024-09-10 08:02:08.482288222 +0000 UTC m=+30.778875539 container cleanup 194a011cca7e9977123cdd392da0650080461e43ac34f3af88070e1e241f03c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:02:08.693 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:08 smithi073 bash[91654]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3 2024-09-10T08:02:08.972 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:08 smithi073 podman[91685]: 2024-09-10 08:02:08.693323707 +0000 UTC m=+0.590285986 container remove 194a011cca7e9977123cdd392da0650080461e43ac34f3af88070e1e241f03c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-10T08:02:08.972 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:08 smithi073 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.3.service: Main process exited, code=exited, status=137/n/a 2024-09-10T08:02:09.069 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:08.802+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:09.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:08.750+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:09.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:08.748+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:09.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:08.748+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:09.284 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:09 smithi073 podman[91776]: 2024-09-10 08:02:08.906227201 +0000 UTC m=+0.016462472 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:02:09.284 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:09 smithi073 podman[91776]: 2024-09-10 08:02:09.04681774 +0000 UTC m=+0.157053010 container create d1d881aaa5d146de524acc1e29962a7f8647841ca87c8399c6895a076dd8f1c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T08:02:09.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:09.070+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:09.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:09.119+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:09.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:09.119+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:09.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:09.194+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:09.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:09.194+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:09.725 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:09.467+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:09.725 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:09.467+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:09.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:09.349+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:09.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:09.349+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:09.726 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:09 smithi073 podman[91776]: 2024-09-10 08:02:09.285767928 +0000 UTC m=+0.396003199 container init d1d881aaa5d146de524acc1e29962a7f8647841ca87c8399c6895a076dd8f1c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-10T08:02:09.726 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:09 smithi073 podman[91776]: 2024-09-10 08:02:09.289266583 +0000 UTC m=+0.399501852 container start d1d881aaa5d146de524acc1e29962a7f8647841ca87c8399c6895a076dd8f1c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T08:02:09.726 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:09 smithi073 podman[91776]: 2024-09-10 08:02:09.369116506 +0000 UTC m=+0.479351782 container attach d1d881aaa5d146de524acc1e29962a7f8647841ca87c8399c6895a076dd8f1c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T08:02:09.726 INFO:journalctl@ceph.osd.3.smithi073.stdout:Sep 10 08:02:09 smithi073 podman[91776]: 2024-09-10 08:02:09.486689668 +0000 UTC m=+0.596924937 container died d1d881aaa5d146de524acc1e29962a7f8647841ca87c8399c6895a076dd8f1c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T08:02:10.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T08:02:10.117 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:02:10.117 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T08:02:10.118 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T08:02:10.118 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.4 2024-09-10T08:02:10.128 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:09.837+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:10.129 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:10.029+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:10.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:09.736+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:10.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:09.710+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:10.157 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:09.710+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:10.460 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:10.305+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:10.460 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:10.305+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:10.503 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:10 smithi102 systemd[1]: Stopping Ceph osd.4 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:02:10.503 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:10.154+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:10.503 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:10.154+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:10.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:10.183+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:10.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:10.183+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:10.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:10.460+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:10.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:10.460+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:10.866 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:10.503+0000 7f1c66bc8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:02:10.866 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:10.503+0000 7f1c66bc8640 -1 osd.4 97 *** Got signal Terminated *** 2024-09-10T08:02:10.866 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:10.503+0000 7f1c66bc8640 -1 osd.4 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:02:11.126 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:10.866+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:11.126 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:11.002+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:11.138 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:10.752+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:11.139 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:10.757+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:11.139 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:10.757+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:11.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:11.139+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:11.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:11.139+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:11.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:11.157+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:11.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:11.157+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:11.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:11.503+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:11.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:11.503+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:11.280+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:11.280+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:12.095 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:11.801+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:12.095 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:11.725+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:12.095 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:11.725+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:12.172 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:11.914+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:12.172 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:12.003+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:12.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:12.095+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:12.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:12.095+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:12.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:12.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:12.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:12.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:12.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:12.327+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:12.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:12.327+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:12.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:12.524+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:12.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:12.524+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:13.092 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:12.827+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:13.092 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:12.774+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:13.092 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:12.774+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:13.376 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:12.943+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:13.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:13.009+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:13.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:13.163+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:13.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:13.163+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:13.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:13.092+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:13.409 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:13.092+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:13.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:13.517+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:13.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:13.517+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:13.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:13.336+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:13.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:13.336+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:14.060 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:13.823+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:14.061 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:13.793+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:14.061 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:13.793+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:14.376 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:13.960+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:14.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:14.052+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:14.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:14.209+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:14.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:14.209+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:14.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:14.061+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:14.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:14.061+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:14.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:14.520+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:14.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:14.520+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:14.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:14.315+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:14.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:14.315+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:15.088 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:14.778+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:15.088 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:14.754+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:15.088 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:14.754+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:15.376 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4[46545]: 2024-09-10T08:02:14.979+0000 7f1c5f1c5640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:34.104151+0000 front 2024-09-10T08:00:34.104114+0000 (oldest deadline 2024-09-10T08:02:04.507183+0000) 2024-09-10T08:02:15.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:15.040+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:15.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:15.161+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:15.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:15.161+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:15.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:15.088+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:15.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:15.088+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:15.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:15.299+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:15.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:15.299+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:15.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:15.475+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:15.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:15.475+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:16.122 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:15.765+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:16.123 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:15.717+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:16.123 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:15.717+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:16.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:16.147+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:16.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:16.147+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:16.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:16.006+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:16.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:16.122+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:16.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:16.122+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:16.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:16.307+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:16.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:16.307+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:16.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:16.459+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:16.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:16.459+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:17.112 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:16.798+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:17.113 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:16.678+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:17.113 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:16.678+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:17.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:16.984+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:17.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:17.159+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:17.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:17.159+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:17.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:17.112+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:17.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:17.112+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:17.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:17.432+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:17.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:17.432+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:17.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:17.336+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:17.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:17.336+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:18.063 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:17.788+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:18.063 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:17.671+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:18.064 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:17.671+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:18.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:17.995+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:18.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:18.184+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:18.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:18.184+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:18.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:18.063+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:18.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:18.063+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:18.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:18.338+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:18.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:18.339+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:18.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:18.425+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:18.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:18.425+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:18.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:18.794+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:18.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:18.627+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:18.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:18.627+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:19.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:19.031+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:19.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:19.184+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:19.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:19.184+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:19.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:19.052+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:19.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:19.052+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:19.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:19.357+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:19.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:19.357+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:19.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:19.414+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:19.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:19.414+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:20.019 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:19.748+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:20.020 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:19.658+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:20.020 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:19.658+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:20.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:19.987+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:20.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:20 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:20.160+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:20.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:20 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:20.160+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:20.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:20.019+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:20.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:20.019+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:20.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:20.408+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:20.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:20.408+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:20.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:20.340+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:20.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:20.340+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:20.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:20.766+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:20.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:20.623+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:20.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:20.623+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:21.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:21.003+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:21.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:21.179+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:21.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:21.179+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:21.410 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:21.018+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:21.410 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:21.018+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:21.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:21.447+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:21.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:21.447+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:21.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:21.296+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:21.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:21.296+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:21.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:21.780+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:21.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:21.590+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:21.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:21.590+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:22.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:21.986+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:22.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:22.168+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:22.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:22.168+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:22.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:22.013+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:22.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:22.013+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:22.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:22.409+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:22.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:22.409+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:22.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:22.271+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:22.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:22.271+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:22.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:22.611+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:22.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:22.611+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:22.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:22.747+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:23.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:22.961+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:23.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:23.157+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:23.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:23.157+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:23.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:23.044+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:23.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:23.044+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:23.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:23.392+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:23.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:23.392+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:23.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:23.284+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:23.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:23.284+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:23.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:23.698+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:23.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:23.567+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:23.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:23.567+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:24.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:23.973+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:24.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:24.127+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:24.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:24.127+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:24.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:24.041+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:24.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:24.041+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:24.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:24 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:24.440+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:24.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:24 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:24.440+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:24.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:24 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:24.298+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:24.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:24 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:24.298+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:24.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:24.722+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:24.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:24.519+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:24.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:24.519+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:25.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:24.993+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:25.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:25 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:25.134+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:25.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:25 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:25.134+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:25.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:24.995+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:25.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:24.995+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:25.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:25 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:25.401+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:25.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:25 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:25.401+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:25.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:25 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:25.307+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:25.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:25 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:25.307+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:25.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:25.738+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:25.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:25.509+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:25.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:25.509+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:26.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:26.038+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:26.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:26.150+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:26.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:26.150+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:26.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:25.997+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:26.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:25.997+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:26.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:26.368+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:26.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:26.368+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:26.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:26.297+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:26.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:26.297+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:26.788 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:26.529+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:26.788 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:26.529+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:27.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:26.788+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:27.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:27.025+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:27.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:27.025+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:27.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:27.135+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:27.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:27.135+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:27.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:27.042+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:27.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:27 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:27.356+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:27.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:27 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:27.356+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:27.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:27 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:27.249+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:27.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:27 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:27.249+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:27.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:27.769+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:27.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:27.569+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:27.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:27.569+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:28.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:28.032+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:28.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:28.087+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:28.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:28.087+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:28.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:28.007+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:28.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:28.007+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:28.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:28 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:28.200+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:28.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:28 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:28.200+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:28.473 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:28 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:28.327+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:28.473 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:28 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:28.328+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:28.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:28.769+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:28.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:28.520+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:28.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:28.520+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:29.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:29 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:29.044+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:29.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:29 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:29.130+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:29.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:29 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:29.130+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:29.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:28.989+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:29.409 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:28.989+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:29.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:29 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:29.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:29.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:29 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:29.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:29.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:29 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:29.238+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:29.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:29 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:29.238+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:29.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:29.772+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:29.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:29.551+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:29.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:29.551+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:30.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:30 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:30.045+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:30.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:30 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:30.092+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:30.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:30 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:30.092+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:30.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:30.000+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:30.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:30.000+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:30.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:30 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:30.337+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:30.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:30 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:30.337+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:30.473 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:30 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:30.191+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:30.473 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:30 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:30.191+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:30.817 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:30.518+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:30.817 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:30.519+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:31.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:30.818+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:31.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:31.002+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:31.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:31.002+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:31.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:31 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:31.043+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:31.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:31 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:31.121+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:31.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:31 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:31.121+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:31.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:31.330+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:31.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:31.330+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:31.473 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:31.198+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:31.473 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:31.199+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:31.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:31.777+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:31.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:31.568+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:31.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:31.568+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:32.277 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:32.010+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:32.278 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:32.172+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:32.278 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:32.172+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:32.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:31.973+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:32.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:31.973+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:32.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:32 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:32.198+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:32.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:32 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:32.198+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:32.473 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:32 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:32.340+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:32.473 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:32 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:32.340+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:32.798 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:32.591+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:32.799 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:32.591+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:33.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:32.799+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:33.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:33.008+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:33.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:33.008+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:33.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:32.975+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:33.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:33 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:33.161+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:33.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:33 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:33.161+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:33.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:33.196+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:33.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:33.196+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:33.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:33.351+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:33.473 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:33.351+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:33.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:33.783+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:33.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:33.629+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:33.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:33.629+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:34.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:33 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:33.940+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:34.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:34 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:34.115+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:34.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:34 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:34.115+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:34.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:34.007+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:34.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:34.007+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:34.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:34.190+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:34.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:34.190+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:34.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:34.374+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:34.473 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:34.374+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:34.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:34.829+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:34.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:34.623+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:34.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:34.623+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:35.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:34 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:34.986+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:35.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:35 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:35.093+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:35.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:35 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:35.093+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:35.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:35.037+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:35.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:35.037+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:35.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:35.387+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:35.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:35.387+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:35.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:35.238+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:35.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:35.238+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:35.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:35.836+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:35.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:35.593+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:35.908 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:35.593+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:36.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:35 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:35.990+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:36.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:36.119+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:36.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:36.119+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:36.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:36.119+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:36.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:36.023+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:36.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:36.023+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:36.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:36.190+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:36.472 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:36.190+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:36.472 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:36.413+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:36.473 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:36.413+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:36.825 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:36.558+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:36.825 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:36.558+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:37.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:36.826+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:37.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:36.996+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:37.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:36.996+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:37.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:36.994+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:37.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:36.994+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:37.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:37 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:37.163+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:37.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:37 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:37.163+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:37.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:37 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:37.163+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:37.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:37.376+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:37.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:37.376+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:37.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:37.230+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:37.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:37.230+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:37.822 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:37.511+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:37.823 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:37.511+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:37.823 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:37.511+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:38.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:37.822+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:38.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:38.043+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:38.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:38.043+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:38.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:38.043+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:38.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:38.005+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:38.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:38.005+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:38.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:38.119+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:38.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:38.119+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:38.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:38.119+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:38.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:38.367+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:38.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:38.367+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:38.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:38.243+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:38.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:38.243+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:38.791 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:38.522+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:38.792 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:38.522+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:38.792 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:38.522+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:39.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:38.791+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:39.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:39.010+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:39.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:39.010+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:39.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:39.010+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:39.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:39.001+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:39.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:39.001+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:39.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:39.084+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:39.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:39.084+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:39.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:39.084+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:39.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:39.378+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:39.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:39.378+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:39.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:39.281+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:39.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:39.281+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:39.823 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:39.525+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:39.824 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:39.525+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:39.824 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:39.525+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:40.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:39.824+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:40.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:39.824+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:40.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:40.020+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:40.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:40.020+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:40.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:40.020+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:40.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:39.999+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:40.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:39.999+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:40.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:40.039+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:40.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:40.039+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:40.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:40.039+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:40.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:40.299+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:40.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:40.299+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:40.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:40.299+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:40.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:40.403+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:40.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:40.403+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:40.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:40.403+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:40.790 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:40.534+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:40.790 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:40.534+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:40.790 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:40.534+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:40.876 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:40 smithi102 bash[71044]: time="2024-09-10T08:02:40Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4 in 30 seconds, resorting to SIGKILL" 2024-09-10T08:02:40.876 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:40 smithi102 podman[71044]: 2024-09-10 08:02:40.609446399 +0000 UTC m=+30.302219801 container died 7f9a0494985f266917db05efb519cf7e0f429b6931d59ca0fd519bcdc0ba0ce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:02:41.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:41.034+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:41.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:41.034+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:41.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:41.034+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:41.158 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:40.790+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:41.158 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:40.790+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:41.237 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:40 smithi102 podman[71044]: 2024-09-10 08:02:40.98653853 +0000 UTC m=+30.679311929 container cleanup 7f9a0494985f266917db05efb519cf7e0f429b6931d59ca0fd519bcdc0ba0ce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T08:02:41.237 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:40 smithi102 bash[71044]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4 2024-09-10T08:02:41.237 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:41.019+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:41.237 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:41.019+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:41.238 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:41.060+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:41.238 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:41.060+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:41.238 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:41.060+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:41.595 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:41 smithi102 podman[71075]: 2024-09-10 08:02:41.237732173 +0000 UTC m=+0.619220771 container remove 7f9a0494985f266917db05efb519cf7e0f429b6931d59ca0fd519bcdc0ba0ce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:02:41.595 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:41 smithi102 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.4.service: Main process exited, code=exited, status=137/n/a 2024-09-10T08:02:41.726 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:41.337+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:41.727 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:41.337+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:41.727 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:41.337+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:41.727 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:41.446+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:41.727 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:41.446+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:41.727 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:41.446+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:41.760 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:41.500+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:41.760 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:41.500+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:41.760 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:41.500+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:41.856 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:41 smithi102 podman[71161]: 2024-09-10 08:02:41.499603865 +0000 UTC m=+0.015847886 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:02:41.856 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:41 smithi102 podman[71161]: 2024-09-10 08:02:41.596824115 +0000 UTC m=+0.113068125 container create f4a2164860870b379db105f74167abbf748b9ed59b0b917cba48fc7f2e090794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T08:02:41.857 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:41 smithi102 podman[71161]: 2024-09-10 08:02:41.857605212 +0000 UTC m=+0.373849219 container init f4a2164860870b379db105f74167abbf748b9ed59b0b917cba48fc7f2e090794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T08:02:42.082 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:41.756+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:42.082 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:41.756+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:42.126 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:41.971+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:42.126 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:41.971+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:42.126 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:41 smithi102 podman[71161]: 2024-09-10 08:02:41.862031447 +0000 UTC m=+0.378275456 container start f4a2164860870b379db105f74167abbf748b9ed59b0b917cba48fc7f2e090794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T08:02:42.127 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:41 smithi102 podman[71161]: 2024-09-10 08:02:41.949256051 +0000 UTC m=+0.465500067 container attach f4a2164860870b379db105f74167abbf748b9ed59b0b917cba48fc7f2e090794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:02:42.127 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 10 08:02:42 smithi102 podman[71161]: 2024-09-10 08:02:42.056377444 +0000 UTC m=+0.572621462 container died f4a2164860870b379db105f74167abbf748b9ed59b0b917cba48fc7f2e090794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T08:02:42.127 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:42.042+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:42.127 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:42.042+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:42.127 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:42.042+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:42.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:42.082+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:42.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:42.082+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:42.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:42.082+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:42.712 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T08:02:42.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:42.295+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:42.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:42.295+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:42.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:42.295+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:42.725 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:42.460+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:42.726 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:42.460+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:42.726 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:42.460+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:42.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:02:42.791 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T08:02:42.792 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T08:02:42.792 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.5 2024-09-10T08:02:42.816 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:42.715+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:42.816 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:42.715+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:42.817 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:42.468+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:42.817 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:42.468+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:42.817 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:42.468+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:43.066 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:42 smithi159 systemd[1]: Stopping Ceph osd.5 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:02:43.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:43.012+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:43.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:43.012+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:43.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:42.991+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:43.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:42.991+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:43.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:42.991+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:43.407 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:43.092+0000 7f650b01c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:02:43.407 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:43.092+0000 7f650b01c640 -1 osd.5 97 *** Got signal Terminated *** 2024-09-10T08:02:43.407 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:43.092+0000 7f650b01c640 -1 osd.5 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:02:43.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:43.066+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:43.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:43.066+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:43.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:43.066+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:43.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:43.416+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:43.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:43.416+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:43.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:43.416+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:43.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:43.275+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:43.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:43.275+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:43.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:43.275+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:43.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:43.496+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:43.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:43.496+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:43.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:43.496+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:43.908 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:43.731+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:43.908 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:43.731+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:44.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:43.981+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:44.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:43.981+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:44.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:43.950+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:44.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:43.950+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:44.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:43.950+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:44.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:44.024+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:44.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:44.024+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:44.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:44.024+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:44.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:44.400+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:44.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:44.400+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:44.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:44.400+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:44.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:44.318+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:44.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:44.318+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:44.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:44.318+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:44.780 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:44.483+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:44.781 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:44.483+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:44.781 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:44.483+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:45.063 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:44.779+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:45.063 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:44.779+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:45.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:44.955+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:45.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:44.955+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:45.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:44.992+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:45.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:44.992+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:45.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:44.992+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:45.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:45.063+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:45.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:45.063+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:45.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:45.063+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:45.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:45.352+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:45.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:45.352+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:45.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:45.352+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:45.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:45.286+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:45.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:45.286+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:45.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:45.286+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:45.825 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:45.453+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:45.825 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:45.453+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:45.825 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:45.453+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:46.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:45.825+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:46.157 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:45.825+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:46.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:46.038+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:46.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:46.038+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:46.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:46.038+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:46.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:45.963+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:46.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:45.963+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:46.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:45.995+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:46.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:45.995+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:46.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:45.995+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:46.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:46.324+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:46.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:46.324+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:46.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:46.324+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:46.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:46.243+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:46.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:46.243+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:46.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:46.243+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:46.779 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:46.413+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:46.779 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:46.413+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:46.779 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:46.413+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:47.035 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:46.779+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:47.035 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:46.779+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:47.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:46.921+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:47.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:46.921+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:47.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:47.026+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:47.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:47.026+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:47.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:47.026+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:47.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:47.035+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:47.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:47.035+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:47.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:47.035+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:47.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:47.336+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:47.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:47.336+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:47.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:47.336+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:47.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:47.272+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:47.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:47.272+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:47.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:47.272+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:47.762 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:47.436+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:04.584964+0000 front 2024-09-10T08:00:04.584897+0000 (oldest deadline 2024-09-10T08:01:31.288858+0000) 2024-09-10T08:02:47.763 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:47.436+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.389696+0000 front 2024-09-10T08:00:35.389709+0000 (oldest deadline 2024-09-10T08:02:03.091452+0000) 2024-09-10T08:02:47.763 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:02:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5[47027]: 2024-09-10T08:02:47.436+0000 7f6507621640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.792184+0000 front 2024-09-10T08:01:07.792202+0000 (oldest deadline 2024-09-10T08:02:37.495393+0000) 2024-09-10T08:02:48.052 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:47.762+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:48.052 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:47.762+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:48.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:47.942+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:48.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:47.942+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:48.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:48.062+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:48.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:48.062+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:48.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:48.062+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:48.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:48.049+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:48.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:48.049+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:48.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:48.049+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:48.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:48.287+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:48.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:48.287+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:48.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:48.287+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:48.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:48.336+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:48.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:48.336+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:48.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:48.336+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:49.039 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:48.749+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:49.039 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:48.749+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:49.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:48.895+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:49.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:48.895+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:49.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:49.063+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:49.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:49.063+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:49.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:49.063+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:49.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:49.039+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:49.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:49.039+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:49.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:49.039+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:49.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:49.324+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:49.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:49.324+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:49.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:49.324+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:49.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:49.275+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:49.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:49.275+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:49.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:49.275+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:50.038 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:49.751+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:50.038 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:49.751+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:50.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:49.891+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:50.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:49.891+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:50.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:50.071+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:50.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:50.071+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:50.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:50.071+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:50.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:50.038+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:50.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:50.038+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:50.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:50.038+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:50.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:50.311+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:50.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:50.311+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:50.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:50.311+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:50.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:50.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:50.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:50.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:50.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:50.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:51.073 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:50.782+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:51.073 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:50.782+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:51.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:50.932+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:51.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:50.932+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:51.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:51.035+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:51.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:51.035+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:51.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:51.035+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:51.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:51.073+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:51.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:51.073+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:51.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:51.073+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:51.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:51.346+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:51.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:51.346+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:51.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:51.347+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:51.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:51.356+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:51.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:51.356+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:51.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:51.356+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:52.122 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:51.783+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:52.122 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:51.783+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:52.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:51.925+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:52.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:51.925+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:52.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:52.044+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:52.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:52.044+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:52.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:52.044+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:52.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:52.122+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:52.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:52.122+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:52.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:52.122+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:52.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:52.327+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:52.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:52.327+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:52.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:52.327+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:52.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:52.306+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:52.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:52.306+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:52.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:52.306+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:53.093 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:52.807+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:53.093 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:52.807+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:53.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:52.955+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:53.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:52.955+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:53.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:53.081+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:53.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:53.081+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:53.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:53.081+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:53.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:53.093+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:53.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:53.093+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:53.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:53.093+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:53.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:53.371+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:53.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:53.371+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:53.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:53.371+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:53.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:53.307+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:53.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:53.307+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:53.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:53.307+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:54.051 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:53.791+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:54.052 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:53.791+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:54.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:53.927+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:54.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:53.927+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:54.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:54.068+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:54.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:54.068+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:54.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:54.068+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:54.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:54.051+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:54.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:54.051+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:54.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:54.051+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:54.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:54.351+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:54.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:54.351+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:54.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:54.351+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:54.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:54.415+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:54.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:54.415+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:54.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:54.415+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:55.094 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:54.762+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:55.094 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:54.762+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:55.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:54.954+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:55.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:54.954+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:55.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:55.059+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:55.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:55.059+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:55.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:55.059+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:55.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:55.094+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:55.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:55.094+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:55.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:55.094+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:55.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:55.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:55.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:55.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:55.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:55.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:55.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:55.411+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:55.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:55.411+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:55.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:55.411+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:56.098 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:55.747+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:56.099 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:55.747+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:56.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:55.963+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:56.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:55.963+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:56.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:56.068+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:56.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:56.068+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:56.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:56.068+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:56.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:56.099+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:56.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:56.099+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:56.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:56.099+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:56.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:56.399+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:56.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:56.399+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:56.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:56.399+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:56.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:56.366+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:56.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:56.366+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:56.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:56.366+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:57.075 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:56.788+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:57.075 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:56.788+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:57.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:56.944+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:57.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:56.944+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:57.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:57.057+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:57.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:57.057+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:57.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:57.057+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:57.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:57.075+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:57.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:57.075+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:57.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:57.075+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:57.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:57.398+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:57.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:57.398+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:57.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:57.398+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:57.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:57.344+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:57.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:57.344+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:57.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:57.344+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:58.096 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:57.760+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:58.096 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:57.760+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:58.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:57.931+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:58.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:57.932+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:58.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:58.093+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:58.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:58.093+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:58.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:58.093+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:58.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:58.096+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:58.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:58.096+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:58.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:58.096+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:58.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:58.412+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:58.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:58.412+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:58.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:58.412+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:58.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:58.379+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:58.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:58.379+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:58.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:58.379+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:02:59.078 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:58.719+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:02:59.079 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:58.719+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:02:59.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:58.915+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:02:59.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:58.915+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:02:59.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:59.140+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:02:59.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:59.140+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:02:59.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:02:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:02:59.140+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:02:59.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:59.079+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:02:59.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:59.079+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:02:59.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:02:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:02:59.079+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:02:59.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:59.433+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:02:59.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:59.433+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:02:59.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:02:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:02:59.433+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:02:59.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:59.338+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:02:59.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:59.338+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:02:59.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:02:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:02:59.338+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:00.099 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:59.731+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:00.100 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:02:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:02:59.731+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:00.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:59.948+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:00.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:02:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:02:59.948+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:00.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:00.126+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:00.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:00.126+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:00.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:00.126+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:00.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:00.100+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:00.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:00.100+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:00.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:00.100+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:00.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:00.388+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:00.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:00.388+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:00.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:00.388+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:00.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:00.377+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:00.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:00.377+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:00.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:00.377+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:01.100 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:00.710+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:01.100 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:00.710+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:01.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:00.910+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:01.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:00.910+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:01.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:01.085+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:01.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:01.085+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:01.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:01.085+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:01.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:01.100+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:01.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:01.100+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:01.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:01.100+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:01.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:01.346+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:01.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:01.346+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:01.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:01.346+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:01.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:01.402+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:01.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:01.402+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:01.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:01.402+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:02.129 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:01.675+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:02.129 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:01.675+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:02.277 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:01.888+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:02.277 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:01.888+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:02.278 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:02.107+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:02.278 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:02.107+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:02.278 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:02.107+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:02.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:02.127+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:02.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:02.127+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:02.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:02.127+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:02.623 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:02.422+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:02.624 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:02.422+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:02.624 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:02.422+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:02.624 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:02.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:02.624 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:02.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:02.624 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:02.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:03.081 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:02.671+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:03.082 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:02.671+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:03.287 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:02.910+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:03.287 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:02.910+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:03.288 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:03.109+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:03.288 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:03.109+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:03.288 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:03.109+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:03.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:03.081+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:03.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:03.081+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:03.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:03.081+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:03.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:03.415+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:03.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:03.415+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:03.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:03.415+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:03.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:03.317+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:03.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:03.317+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:03.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:03.317+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:03.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:03.652+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:03.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:03.652+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:04.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:03.910+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:04.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:03.910+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:04.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:04.065+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:04.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:04.065+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:04.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:04.065+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:04.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:04.093+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:04.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:04.093+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:04.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:04.093+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:04.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:04.334+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:04.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:04.334+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:04.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:04.334+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:04.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:04.374+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:04.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:04.374+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:04.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:04.374+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:04.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:04.624+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:04.908 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:04.624+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:05.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:05.109+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:05.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:05.109+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:05.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:05.109+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:05.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:04.902+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:05.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:04.902+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:05.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:05.077+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:05.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:05.077+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:05.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:05.077+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:05.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:05.332+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:05.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:05.332+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:05.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:05.332+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:05.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:05.343+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:05.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:05.343+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:05.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:05.343+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:05.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:05.591+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:05.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:05.591+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:06.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:05.939+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:06.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:05.939+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:06.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:06.126+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:06.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:06.126+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:06.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:06.126+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:06.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:06.117+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:06.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:06.117+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:06.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:06.117+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:06.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:06.355+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:06.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:06.355+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:06.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:06.355+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:06.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:06.337+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:06.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:06.337+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:06.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:06.337+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:06.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:06.602+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:06.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:06.602+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:07.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:06.926+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:07.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:06.926+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:07.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:07.102+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:07.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:07.102+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:07.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:07.102+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:07.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:07.079+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:07.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:07.079+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:07.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:07.079+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:07.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:07.399+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:07.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:07.399+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:07.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:07.399+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:07.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:07.299+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:07.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:07.299+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:07.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:07.299+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:07.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:07.555+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:07.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:07.555+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:08.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:07.902+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:08.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:07.902+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:08.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:08.066+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:08.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:08.066+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:08.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:08.066+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:08.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:08.039+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:08.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:08.039+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:08.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:08.039+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:08.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:08.363+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:08.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:08.363+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:08.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:08.363+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:08.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:08.277+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:08.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:08.277+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:08.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:08.277+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:08.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:08.570+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:08.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:08.570+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:09.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:08.949+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:09.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:08.949+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:09.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:08.949+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:09.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:09.071+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:09.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:09.071+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:09.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:09.072+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:09.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:09.024+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:09.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:09.024+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:09.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:09.024+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:09.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:09.024+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:09.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:09.259+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:09.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:09.259+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:09.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:09.259+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:09.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:09.363+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:09.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:09.363+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:09.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:09.363+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:09.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:09.363+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:09.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:09.533+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:09.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:09.533+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:10.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:09.976+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:10.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:09.976+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:10.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:09.976+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:10.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:10.085+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:10.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:10.085+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:10.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:10.085+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:10.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:10.085+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:10.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:09.996+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:10.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:09.996+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:10.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:09.996+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:10.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:09.996+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:10.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:10.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:10.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:10.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:10.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:10.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:10.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:10.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:10.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:10.304+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:10.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:10.304+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:10.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:10.304+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:10.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:10.304+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:10.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:10.494+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:10.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:10.494+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:11.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:10.940+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:11.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:10.940+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:11.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:10.940+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:11.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:11.101+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:11.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:11.101+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:11.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:11.101+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:11.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:11.101+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:11.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:10.975+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:11.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:10.975+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:11.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:10.975+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:11.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:10.975+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:11.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:11.397+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:11.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:11.397+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:11.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:11.397+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:11.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:11.397+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:11.294+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:11.294+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:11.294+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:11.294+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:11.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:11.533+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:11.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:11.533+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:12.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:11.963+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:12.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:11.963+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:12.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:11.963+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:12.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:12.129+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:12.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:12.129+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:12.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:12.129+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:12.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:12.129+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:12.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:11.947+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:12.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:11.947+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:12.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:11.947+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:12.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:11.947+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:12.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:12.312+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:12.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:12.312+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:12.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:12.312+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:12.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:12.312+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:12.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:12.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:12.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:12.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:12.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:12.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:12.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:12 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:12.385+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:12.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:12.489+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:12.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:12.489+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:13.210 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:13 smithi159 bash[71656]: time="2024-09-10T08:03:13Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5 in 30 seconds, resorting to SIGKILL" 2024-09-10T08:03:13.211 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:12.911+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:13.211 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:12.911+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:13.211 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:12.911+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:13.211 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:12.911+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:13.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:12.981+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:13.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:12.981+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:13.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:12.981+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:13.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:13.125+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:13.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:13.125+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:13.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:13.125+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:13.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:13.125+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:13.486 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:13 smithi159 podman[71656]: 2024-09-10 08:03:13.211779275 +0000 UTC m=+30.220216267 container died 00b00926d70b3aa59faf8a9b28de337b74c686d262e9470ac6ac1cb70525da3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T08:03:13.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:13.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:13.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:13.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:13.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:13.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:13.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:13.360+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:13.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:13.354+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:13.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:13.354+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:13.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:13.354+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:13.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:13 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:13.354+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:13.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:13 smithi159 podman[71656]: 2024-09-10 08:03:13.57867303 +0000 UTC m=+30.587110070 container cleanup 00b00926d70b3aa59faf8a9b28de337b74c686d262e9470ac6ac1cb70525da3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:03:13.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:13 smithi159 bash[71656]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5 2024-09-10T08:03:13.908 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:13.490+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:13.908 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:13.490+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:13.908 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:13.490+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:13.972 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:13.971+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:13.973 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:13.971+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:13.973 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:13.972+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:14.335 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:13 smithi159 podman[71676]: 2024-09-10 08:03:13.946772966 +0000 UTC m=+0.732208690 container remove 00b00926d70b3aa59faf8a9b28de337b74c686d262e9470ac6ac1cb70525da3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T08:03:14.335 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:13 smithi159 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.5.service: Main process exited, code=exited, status=137/n/a 2024-09-10T08:03:14.336 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:13.918+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:14.336 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:13.918+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:14.336 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:13.918+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:14.336 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:13.918+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:14.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:14.156+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:14.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:14.156+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:14.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:14.156+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:14.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:14.156+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:14.640 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:14.466+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:14.641 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:14.466+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:14.641 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:14.466+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:14.641 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:14 smithi159 podman[71763]: 2024-09-10 08:03:14.239628089 +0000 UTC m=+0.016598077 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:03:14.641 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:14 smithi159 podman[71763]: 2024-09-10 08:03:14.361065548 +0000 UTC m=+0.138035529 container create fc92b0af09447ad6f82c21d59592aa5fafbbc7a485eec23c0640921aecb70aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-10T08:03:14.641 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:14 smithi159 podman[71763]: 2024-09-10 08:03:14.566520594 +0000 UTC m=+0.343490577 container init fc92b0af09447ad6f82c21d59592aa5fafbbc7a485eec23c0640921aecb70aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T08:03:14.642 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:14 smithi159 podman[71763]: 2024-09-10 08:03:14.570035338 +0000 UTC m=+0.347005315 container start fc92b0af09447ad6f82c21d59592aa5fafbbc7a485eec23c0640921aecb70aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T08:03:14.642 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:14 smithi159 podman[71763]: 2024-09-10 08:03:14.641809366 +0000 UTC m=+0.418779359 container attach fc92b0af09447ad6f82c21d59592aa5fafbbc7a485eec23c0640921aecb70aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T08:03:14.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:14.379+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:14.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:14.379+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:14.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:14.379+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:14.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:14.379+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:14.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:14.347+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:14.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:14.347+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:14.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:14.347+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:14.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:14 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:14.347+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:14.907 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 10 08:03:14 smithi159 podman[71763]: 2024-09-10 08:03:14.765533241 +0000 UTC m=+0.542503220 container died fc92b0af09447ad6f82c21d59592aa5fafbbc7a485eec23c0640921aecb70aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2) 2024-09-10T08:03:15.369 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:14.959+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:15.369 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:14.959+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:15.369 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:14.959+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:15.369 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:14.959+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:15.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:15.175+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:15.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:15.175+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:15.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:15.175+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:15.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:15.175+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:15.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:14.984+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:15.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:14.984+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:15.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:14.984+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:15.384 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T08:03:15.465 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:03:15.466 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T08:03:15.466 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T08:03:15.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.6 2024-09-10T08:03:15.636 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:15.486+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:15.637 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:15.486+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:15.637 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:15.486+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:15.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:15.315+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:15.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:15.315+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:15.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:15.315+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:15.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:15.315+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:15.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:15.340+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:15.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:15.340+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:15.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:15.340+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:15.724 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:15.340+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:15.724 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:15 smithi073 systemd[1]: Stopping Ceph osd.6 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:03:16.222 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:15.762+0000 7f385f1e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:03:16.222 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:15.762+0000 7f385f1e3640 -1 osd.6 97 *** Got signal Terminated *** 2024-09-10T08:03:16.223 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:15 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:15.762+0000 7f385f1e3640 -1 osd.6 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:03:16.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:15.942+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:16.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:15.942+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:16.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:15.942+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:16.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:16.191+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:16.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:16.191+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:16.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:16.191+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:16.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:16.191+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:16.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:15.920+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:16.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:15.920+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:16.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:15.920+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:16.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:15.920+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:16.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:16.292+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:16.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:16.292+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:16.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:16.292+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:16.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:16.292+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:16.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:16.388+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:16.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:16.388+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:16.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:16.388+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:16.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:16 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:16.388+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:16.876 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:16.447+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:16.877 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:16.447+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:16.877 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:16.447+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:17.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:16.877+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:17.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:16.877+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:17.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:16.877+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:17.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:16.877+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:17.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:16.959+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:17.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:16.959+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:17.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:16.959+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:17.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:17.182+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:17.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:17.182+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:17.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:17.182+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:17.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:17.182+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:17.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:17.429+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:17.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:17.429+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:17.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:17.429+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:17.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:17.429+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:17.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:17.290+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:17.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:17.290+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:17.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:17.290+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:17.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:17 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:17.290+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:17.893 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:17.476+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:17.893 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:17.476+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:17.894 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:17.476+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:18.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:17.893+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:18.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:17.893+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:18.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:17.893+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:18.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:17.893+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:18.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:17.997+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:18.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:17.997+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:18.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:17.997+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:18.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:18.205+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:18.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:18.205+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:18.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:18.205+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:18.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:18.205+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:18.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:18.444+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:18.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:18.444+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:18.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:18.444+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:18.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:18.444+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:18.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:18.276+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:18.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:18.276+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:18.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:18.276+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:18.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:18 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:18.276+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:18.871 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:18.459+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:18.871 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:18.459+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:18.871 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:18.459+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:19.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:18.871+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:19.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:18.871+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:19.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:18.871+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:19.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:18.871+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:19.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:19.164+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:19.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:19.164+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:19.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:19.164+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:19.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:19.164+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:19.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:19.039+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:19.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:19.039+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:19.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:19.039+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:19.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:19.424+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:19.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:19.424+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:19.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:19.424+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:19.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:19.424+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:19.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:19.298+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:19.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:19.298+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:19.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:19.298+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:19.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:19 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:19.298+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:19.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:19.421+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:19.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:19.421+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:19.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:19.421+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:20.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:20 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:20.008+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:20.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:20 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:20.008+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:20.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:20 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:20.008+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:20.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:20 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:20.205+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:20.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:20 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:20.205+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:20.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:20 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:20.205+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:20.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:20 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:20.205+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:20.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:19.908+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:20.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:19.908+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:20.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:19.908+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:20.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:19.908+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:20.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:20.400+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:03.517829+0000 front 2024-09-10T08:00:03.517887+0000 (oldest deadline 2024-09-10T08:01:33.221782+0000) 2024-09-10T08:03:20.722 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:20.400+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.222066+0000 front 2024-09-10T08:00:33.222085+0000 (oldest deadline 2024-09-10T08:02:03.625577+0000) 2024-09-10T08:03:20.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:20.400+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.426935+0000 front 2024-09-10T08:01:09.426909+0000 (oldest deadline 2024-09-10T08:02:40.330961+0000) 2024-09-10T08:03:20.723 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6[58896]: 2024-09-10T08:03:20.400+0000 7f38577e0640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.431557+0000 front 2024-09-10T08:01:41.431536+0000 (oldest deadline 2024-09-10T08:03:09.237930+0000) 2024-09-10T08:03:20.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:20.284+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:20.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:20.284+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:20.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:20.284+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:20.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:20 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:20.284+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:20.883 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:20.409+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:20.883 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:20.409+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:20.883 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:20.409+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:21.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:20.883+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:21.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:20.883+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:21.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:20.883+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:21.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:20.883+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:21.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:21.051+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:21.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:21.051+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:21.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:21.051+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:21.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:21.250+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:21.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:21.250+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:21.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:21.250+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:21.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:21 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:21.250+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:21.613 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:21.314+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:21.613 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:21.314+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:21.613 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:21.314+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:21.613 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:21 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:21.314+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:21.897 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:21.439+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:21.897 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:21.439+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:21.897 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:21.439+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:21.909 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:21 smithi073 podman[91878]: 2024-09-10 08:03:21.614379161 +0000 UTC m=+5.953212958 container died 134ceaa189e8e1d65d55645770fd085b486fd26c3c577b830ea021265828615e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T08:03:22.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:21.897+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:22.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:21.897+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:22.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:21.897+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:22.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:21.897+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:22.222 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:21 smithi073 podman[91878]: 2024-09-10 08:03:21.976866491 +0000 UTC m=+6.315700290 container cleanup 134ceaa189e8e1d65d55645770fd085b486fd26c3c577b830ea021265828615e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:03:22.222 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:21 smithi073 bash[91878]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6 2024-09-10T08:03:22.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:22.076+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:22.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:22.076+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:22.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:22.076+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:22.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:22.201+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:22.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:22.201+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:22.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:22.201+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:22.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:22 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:22.201+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:22.624 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:22 smithi073 podman[91893]: 2024-09-10 08:03:22.288021815 +0000 UTC m=+0.664850063 container remove 134ceaa189e8e1d65d55645770fd085b486fd26c3c577b830ea021265828615e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T08:03:22.625 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:22.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:22.625 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:22.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:22.625 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:22.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:22.625 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:22 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:22.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:22.904 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:22.438+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:22.904 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:22.438+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:22.904 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:22.438+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:22.924 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:22 smithi073 podman[91985]: 2024-09-10 08:03:22.528500116 +0000 UTC m=+0.015819432 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:03:22.924 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:22 smithi073 podman[91985]: 2024-09-10 08:03:22.63906911 +0000 UTC m=+0.126388415 container create 61b6b381ac73c2f1820af37e827746a5ad5204ff11a2b6407c42199749bdcee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:03:22.924 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:22 smithi073 podman[91985]: 2024-09-10 08:03:22.841485809 +0000 UTC m=+0.328805110 container init 61b6b381ac73c2f1820af37e827746a5ad5204ff11a2b6407c42199749bdcee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:03:22.924 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:22 smithi073 podman[91985]: 2024-09-10 08:03:22.844799914 +0000 UTC m=+0.332119220 container start 61b6b381ac73c2f1820af37e827746a5ad5204ff11a2b6407c42199749bdcee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T08:03:22.924 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:22 smithi073 podman[91985]: 2024-09-10 08:03:22.924706532 +0000 UTC m=+0.412025844 container attach 61b6b381ac73c2f1820af37e827746a5ad5204ff11a2b6407c42199749bdcee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T08:03:23.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:22.904+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:23.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:22.904+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:23.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:22.904+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:23.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:22.904+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:23.222 INFO:journalctl@ceph.osd.6.smithi073.stdout:Sep 10 08:03:23 smithi073 podman[91985]: 2024-09-10 08:03:23.034507522 +0000 UTC m=+0.521826837 container died 61b6b381ac73c2f1820af37e827746a5ad5204ff11a2b6407c42199749bdcee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T08:03:23.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:23.097+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:23.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:23.097+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:23.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:23.097+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:23.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:23.209+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:23.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:23.209+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:23.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:23.209+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:23.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:23.209+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:23.618 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:23.400+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:23.619 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:23.400+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:23.619 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:23.400+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:23.619 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:23 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:23.400+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:23.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T08:03:23.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:03:23.678 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T08:03:23.678 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T08:03:23.679 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.7 2024-09-10T08:03:23.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:23.446+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:23.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:23.446+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:23.907 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:23.446+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:23.987 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:23 smithi102 systemd[1]: Stopping Ceph osd.7 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:03:24.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:23.987+0000 7fef6ce1c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:03:24.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:23.987+0000 7fef6ce1c640 -1 osd.7 97 *** Got signal Terminated *** 2024-09-10T08:03:24.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:23 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:23.987+0000 7fef6ce1c640 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:03:24.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:24.146+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:24.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:24.146+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:24.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:24.146+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:24.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:24.174+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:24.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:24.174+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:24.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:24.174+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:24.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:24 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:24.174+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:24.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:23.939+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:24.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:23.939+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:24.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:23.939+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:24.408 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:23.939+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:24.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:24 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:24.411+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:24.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:24 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:24.411+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:24.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:24 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:24.411+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:24.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:24 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:24.411+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:24.904 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:24.445+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:24.904 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:24.445+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:24.904 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:24.445+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:25.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:24.904+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:25.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:24.904+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:25.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:24.904+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:25.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:24.904+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:25.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:25 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:25.101+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:25.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:25 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:25.101+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:25.377 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:25 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:25.101+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:25.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:25 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:25.197+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:25.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:25 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:25.197+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:25.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:25 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:25.197+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:25.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:25 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:25.197+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:25.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:25 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:25.460+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:25.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:25 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:25.460+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:25.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:25 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:25.460+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:25.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:25 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:25.460+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:25.901 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:25.411+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:25.901 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:25.411+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:25.901 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:25.411+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:26.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:25.901+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:26.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:25.901+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:26.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:25.901+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:26.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:25.901+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:26.626 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:26.129+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:26.626 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:26.129+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:26.627 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:26.129+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:26.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:26.174+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:26.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:26.174+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:26.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:26.174+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:26.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:26 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:26.174+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:26.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:26.375+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:26.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:26.375+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:26.658 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:26.375+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:26.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:26.488+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:26.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:26.488+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:26.973 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:26.488+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:26.973 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:26 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:26.488+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:27.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:26.865+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:27.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:26.865+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:27.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:26.865+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:27.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:26.865+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:27.626 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:27.128+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:27.626 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:27.128+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:27.626 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:27.128+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:27.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:27.187+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:27.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:27.187+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:27.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:27.187+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:27.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:27 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:27.187+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:27.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:27.370+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:27.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:27.370+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:27.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:27.370+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:27.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:27 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:27.490+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:27.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:27 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:27.490+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:27.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:27 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:27.490+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:27.973 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:27 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:27.490+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:28.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:27.841+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:28.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:27.841+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:28.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:27.841+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:28.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:27.841+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:28.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:28.095+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.752581+0000 front 2024-09-10T08:00:33.752599+0000 (oldest deadline 2024-09-10T08:02:02.955570+0000) 2024-09-10T08:03:28.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:28.095+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:07.056185+0000 front 2024-09-10T08:01:07.056300+0000 (oldest deadline 2024-09-10T08:02:36.760005+0000) 2024-09-10T08:03:28.376 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-10T08:03:28.095+0000 7fef65419640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:40.761299+0000 front 2024-09-10T08:01:40.761338+0000 (oldest deadline 2024-09-10T08:03:08.764569+0000) 2024-09-10T08:03:28.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:28.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:28.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:28.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:28.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:28.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:28.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:28 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:28.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:28.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:28.371+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:28.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:28.371+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:28.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:28.371+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:28.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:28 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:28.472+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:28.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:28 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:28.472+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:28.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:28 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:28.472+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:28.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:28 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:28.472+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:29.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:28.891+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:29.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:28.891+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:29.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:28.891+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:29.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:28 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:28.891+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:29.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:29 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:29.188+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:29.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:29 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:29.188+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:29.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:29 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:29.188+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:29.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:29 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:29.188+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:29.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:29.393+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:29.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:29.393+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:29.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:29.393+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:29.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:29 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:29.424+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:29.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:29 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:29.424+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:29.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:29 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:29.424+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:29.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:29 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:29.424+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:30.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:29.866+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:30.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:29.866+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:30.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:29.866+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:30.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:29 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:29.866+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:30.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:30 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:30.140+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:30.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:30 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:30.140+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:30.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:30 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:30.140+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:30.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:30 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:30.140+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:30.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:30 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:30.439+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:30.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:30 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:30.439+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:30.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:30 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:30.439+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:30.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:30 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:30.439+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:30.889 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:30.409+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:30.890 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:30.409+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:30.890 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:30.409+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:31.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:30.890+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:31.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:30.890+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:31.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:30.890+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:31.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:30 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:30.890+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:31.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:31 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:31.164+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:31.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:31 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:31.164+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:31.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:31 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:31.164+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:31.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:31 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:31.164+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:31.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:31.366+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:31.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:31.366+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:31.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:31.366+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:31.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:31.400+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:31.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:31.400+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:31.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:31.400+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:31.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:31.400+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:32.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:31.844+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:32.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:31.844+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:32.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:31.844+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:32.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:31 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:31.844+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:32.527 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:32.211+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:32.527 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:32.211+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:32.527 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:32.211+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:32.527 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:32 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:32.211+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:32.623 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:32 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:32.368+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:32.624 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:32 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:32.368+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:32.624 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:32 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:32.368+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:32.624 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:32 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:32.368+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:32.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:32.370+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:32.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:32.370+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:32.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:32.370+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:33.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:32.887+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:33.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:32.887+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:33.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:32.887+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:33.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:32 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:32.887+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:33.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:33 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:33.207+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:33.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:33 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:33.207+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:33.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:33 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:33.207+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:33.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:33 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:33.207+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:33.637 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:33.347+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:33.637 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:33.347+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:33.637 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:33.347+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:33.637 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:33 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:33.347+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:33.846 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:33.419+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:33.846 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:33.419+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:33.846 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:33.419+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:34.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:33.845+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:34.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:33.845+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:34.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:33.845+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:34.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:33 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:33.845+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:34.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:34 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:34.255+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:34.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:34 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:34.255+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:34.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:34 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:34.255+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:34.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:34 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:34.255+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:34.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:34.372+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:34.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:34.372+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:34.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:34.372+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:34.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:34.365+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:34.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:34.365+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:34.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:34.365+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:34.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:34 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:34.365+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:35.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:34.803+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:35.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:34.803+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:35.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:34.803+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:35.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:34 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:34.803+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:35.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:35 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:35.260+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:35.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:35 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:35.260+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:35.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:35 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:35.260+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:35.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:35 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:35.260+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:35.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:35.379+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:35.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:35.379+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:35.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:35.379+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:35.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:35.398+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:35.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:35.398+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:35.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:35.398+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:35.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:35 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:35.398+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:36.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:35.843+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:36.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:35.843+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:36.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:35.843+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:36.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:35 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:35.843+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:36.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:36.280+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:36.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:36.280+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:36.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:36.280+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:36.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:36 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:36.280+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:36.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:36.401+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:36.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:36.401+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:36.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:36.401+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:36.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:36.407+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:36.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:36.407+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:36.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:36.407+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:36.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:36.407+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:37.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:36.806+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:37.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:36.806+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:37.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:36.806+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:37.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:36 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:36.806+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:37.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:37 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:37.266+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:37.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:37 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:37.266+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:37.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:37 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:37.266+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:37.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:37 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:37.266+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:37.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:37.375+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:37.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:37.375+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:37.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:37.375+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:37.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:37 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:37.375+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:37.821 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:37.410+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:37.821 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:37.410+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:37.821 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:37.410+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:38.126 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:37 smithi102 podman[71277]: 2024-09-10 08:03:37.77621545 +0000 UTC m=+13.906677626 container died 2cb8d5e5514e090d2edc4ef46b084ee0a57ec3176b9319fbcd0602333354bf0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T08:03:38.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:37.821+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:38.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:37.821+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:38.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:37.821+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:38.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:37 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:37.821+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:38.626 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:38 smithi102 podman[71277]: 2024-09-10 08:03:38.437491989 +0000 UTC m=+14.567954161 container cleanup 2cb8d5e5514e090d2edc4ef46b084ee0a57ec3176b9319fbcd0602333354bf0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T08:03:38.626 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:38 smithi102 bash[71277]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7 2024-09-10T08:03:38.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:38.235+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:38.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:38.235+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:38.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:38.235+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:38.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:38 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:38.235+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:38.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:38.362+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:38.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:38.362+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:38.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:38.362+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:38.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:38.329+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:38.951 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:38.330+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:38.951 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:38.330+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:38.951 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:38 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:38.330+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:39.043 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:38 smithi102 podman[71293]: 2024-09-10 08:03:38.630350777 +0000 UTC m=+0.858137816 container remove 2cb8d5e5514e090d2edc4ef46b084ee0a57ec3176b9319fbcd0602333354bf0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T08:03:39.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:38.852+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:39.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:38.852+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:39.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:38.852+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:39.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:38 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:38.852+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:39.340 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:39.244+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:39.341 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:39.244+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:39.341 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:39.244+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:39.341 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:39 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:39.244+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:39.341 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:39 smithi102 podman[71383]: 2024-09-10 08:03:38.94724512 +0000 UTC m=+0.016268198 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:03:39.341 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:39 smithi102 podman[71383]: 2024-09-10 08:03:39.047892884 +0000 UTC m=+0.116915960 container create 8a4bd04a180aaed4d9ed73bb93e510dba1de1c04f945dd59ced3a36317c2d072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T08:03:39.341 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:39 smithi102 podman[71383]: 2024-09-10 08:03:39.258525872 +0000 UTC m=+0.327548941 container init 8a4bd04a180aaed4d9ed73bb93e510dba1de1c04f945dd59ced3a36317c2d072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True) 2024-09-10T08:03:39.341 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:39 smithi102 podman[71383]: 2024-09-10 08:03:39.261706597 +0000 UTC m=+0.330729675 container start 8a4bd04a180aaed4d9ed73bb93e510dba1de1c04f945dd59ced3a36317c2d072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:03:39.342 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:39 smithi102 podman[71383]: 2024-09-10 08:03:39.341817929 +0000 UTC m=+0.410841012 container attach 8a4bd04a180aaed4d9ed73bb93e510dba1de1c04f945dd59ced3a36317c2d072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T08:03:39.626 INFO:journalctl@ceph.osd.7.smithi102.stdout:Sep 10 08:03:39 smithi102 podman[71383]: 2024-09-10 08:03:39.455976933 +0000 UTC m=+0.525000014 container died 8a4bd04a180aaed4d9ed73bb93e510dba1de1c04f945dd59ced3a36317c2d072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T08:03:39.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:39.384+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:39.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:39.384+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:39.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:39.384+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:39.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:39.286+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:39.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:39.286+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:39.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:39.286+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:39.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:39 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:39.286+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:40.032 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T08:03:40.070 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:03:40.071 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T08:03:40.071 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T08:03:40.071 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.8 2024-09-10T08:03:40.094 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:39.814+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:40.094 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:39.814+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:40.095 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:39.814+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:40.095 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:39 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:39.814+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:40.363 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:40 smithi159 systemd[1]: Stopping Ceph osd.8 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:03:40.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:40.266+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:40.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:40.266+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:40.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:40.266+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:40.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:40 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:40.266+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:40.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:40.363+0000 7f800e1e4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:03:40.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:40.363+0000 7f800e1e4640 -1 osd.8 97 *** Got signal Terminated *** 2024-09-10T08:03:40.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:40.363+0000 7f800e1e4640 -1 osd.8 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:03:40.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:40.396+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:40.658 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:40.396+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:40.658 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:40.396+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:40.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:40.296+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:40.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:40.296+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:40.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:40.296+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:40.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:40 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:40.296+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:41.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:40.770+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:41.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:40.770+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:41.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:40.770+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:41.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:40 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:40.770+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:41.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:41.276+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:41.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:41.276+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:41.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:41.276+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:41.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:41 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:41.276+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:41.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:41.363+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:41.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:41.363+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:41.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:41.363+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:41.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:41.261+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:41.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:41.261+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:41.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:41.261+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:41.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:41.261+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:42.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:41.766+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:42.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:41.766+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:42.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:41.766+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:42.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:41.766+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:42.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:41 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:41.766+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:42.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:42.253+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:42.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:42.253+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:42.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:42.253+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:42.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:42.253+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:42.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:42 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:42.253+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:42.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:42.257+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:42.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:42.257+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:42.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:42.257+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:42.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:42 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:42.257+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:42.781 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:42.408+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:42.781 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:42.408+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:42.781 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:42.408+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:43.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:42.781+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:43.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:42.781+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:43.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:42.781+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:43.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:42.781+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:43.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:42 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:42.781+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:43.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:43.237+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:43.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:43.237+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:43.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:43.237+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:43.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:43.237+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:43.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:43 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:43.237+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:43.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:43.369+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:43.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:43.369+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:43.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:43.369+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:43.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:43.369+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:14.457243+0000 front 2024-09-10T08:02:14.457226+0000 (oldest deadline 2024-09-10T08:03:42.461200+0000) 2024-09-10T08:03:43.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:43.224+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:43.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:43.224+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:43.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:43.224+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:43.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:43 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:43.224+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:44.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:43.784+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:44.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:43.784+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:44.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:43.784+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:44.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:43.784+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:44.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:43 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:43.784+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:44.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:44.255+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:44.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:44.255+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:44.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:44.255+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:44.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:44.255+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:44.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:44 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:44.255+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:44.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:44.328+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:44.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:44.328+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:44.658 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:44.328+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:44.658 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:44.328+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:14.457243+0000 front 2024-09-10T08:02:14.457226+0000 (oldest deadline 2024-09-10T08:03:42.461200+0000) 2024-09-10T08:03:44.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:44.266+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:44.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:44.266+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:44.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:44.266+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:44.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:44.266+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:44.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:44 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:44.266+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:45.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:44.749+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:45.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:44.749+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:45.160 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:44.749+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:45.161 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:44.749+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:45.161 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:44 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:44.749+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:45.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:45.229+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:45.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:45.229+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:45.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:45.229+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:45.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:45.229+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:45.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:45 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:45.229+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:45.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:45.341+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:35.643855+0000 front 2024-09-10T08:00:35.643870+0000 (oldest deadline 2024-09-10T08:02:05.147680+0000) 2024-09-10T08:03:45.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:45.341+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.348899+0000 front 2024-09-10T08:01:10.348915+0000 (oldest deadline 2024-09-10T08:02:38.852670+0000) 2024-09-10T08:03:45.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:45.341+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:39.353590+0000 front 2024-09-10T08:01:39.353620+0000 (oldest deadline 2024-09-10T08:03:13.356330+0000) 2024-09-10T08:03:45.658 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:03:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8[54019]: 2024-09-10T08:03:45.341+0000 7f800a7e9640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:14.457243+0000 front 2024-09-10T08:02:14.457226+0000 (oldest deadline 2024-09-10T08:03:42.461200+0000) 2024-09-10T08:03:45.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:45.273+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:45.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:45.273+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:45.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:45.273+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:45.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:45.273+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:45.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:45.273+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:46.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:45.744+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:46.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:45.744+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:46.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:45.744+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:46.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:45.744+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:46.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:45 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:45.744+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:46.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:46.246+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:46.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:46.246+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:46.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:46.246+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:46.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:46.246+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:46.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:46 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:46.246+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:46.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:46.306+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:46.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:46.306+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:46.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:46.306+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:46.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:46.306+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:46.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:46 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:46.306+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:47.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:46.714+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:47.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:46.715+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:47.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:46.715+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:47.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:46.715+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:47.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:46 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:46.715+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:47.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:47.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:47.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:47.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:47.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:47.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:47.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:47.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:47.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:47 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:47.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:47.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:47.346+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:47.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:47.346+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:47.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:47.346+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:47.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:47.346+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:47.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:47 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:47.346+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:48.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:47.666+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:48.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:47.666+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:48.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:47.666+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:48.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:47.666+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:48.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:47 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:47.666+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:48.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:48.171+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:48.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:48.171+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:48.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:48.171+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:48.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:48.171+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:48.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:48 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:48.171+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:48.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:48.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:48.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:48.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:48.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:48.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:48.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:48.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:48.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:48 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:48.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:48.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:48.640+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:48.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:48.640+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:48.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:48.640+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:48.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:48.640+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:48.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:48 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:48.640+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:49.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:49.214+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:49.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:49.214+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:49.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:49.214+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:49.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:49.214+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:49.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:49 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:49.214+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:49.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:49.399+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:49.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:49.399+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:49.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:49.399+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:49.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:49.399+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:49.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:49 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:49.399+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:50.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:49.661+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:50.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:49.661+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:50.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:49.661+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:50.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:49.661+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:50.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:49 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:49.661+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:50.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:50.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:50.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:50.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:50.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:50.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:50.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:50.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:50.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:50.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:50.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:50.377+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:50.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:50.377+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:50.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:50.377+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:50.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:50.377+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:50.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:50 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:50.377+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:51.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:50.685+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:51.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:50.685+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:51.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:50.685+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:51.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:50.685+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:51.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:50 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:50.685+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:51.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:51.159+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:51.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:51.159+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:51.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:51.159+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:51.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:51.159+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:51.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:51 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:51.159+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:51.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:51.425+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:51.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:51.425+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:51.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:51.425+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:51.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:51.425+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:51.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:51 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:51.425+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:52.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:51.674+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:52.157 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:51.674+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:52.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:51.674+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:52.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:51.674+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:52.158 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:51 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:51.674+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:52.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:52.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:52.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:52.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:52.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:52.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:52.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:52.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:52.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:52 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:52.173+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:52.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:52.437+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:52.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:52.437+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:52.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:52.437+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:52.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:52.437+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:52.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:52 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:52.437+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:52.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:52.635+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:52.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:52.635+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:52.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:52.635+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:52.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:52.635+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:52.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:52 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:52.635+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:53.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:53.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:53.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:53.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:53.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:53.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:53.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:53.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:53.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:53 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:53.217+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:53.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:53.413+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:53.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:53.413+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:53.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:53.413+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:53.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:53.413+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:53.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:53 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:53.413+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:53.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:53.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:53.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:53.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:53.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:53.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:53.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:53.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:53.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:53 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:53.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:54.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:54.264+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:54.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:54.264+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:54.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:54.264+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:54.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:54.264+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:54.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:54 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:54.264+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:54.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:54.455+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:54.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:54.455+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:54.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:54.455+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:54.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:54.455+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:54.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:54 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:54.455+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:54.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:54.585+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:54.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:54.585+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:54.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:54.585+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:54.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:54.585+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:54.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:54 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:54.585+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:55.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:55.239+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:55.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:55.239+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:55.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:55.239+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:55.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:55.239+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:55.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:55.239+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:55.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:55.432+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:55.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:55.432+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:55.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:55.432+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:55.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:55.432+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:55.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:55 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:55.432+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:55.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:55.587+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:55.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:55.587+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:55.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:55.587+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:55.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:55.587+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:55.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:55 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:55.587+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:56.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:56.200+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:56.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:56.200+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:56.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:56.200+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:56.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:56.200+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:56.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:56 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:56.200+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:56.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:56.449+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:56.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:56.449+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:56.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:56.449+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:56.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:56.449+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:56.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:56 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:56.449+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:56.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:56.559+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:56.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:56.559+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:56.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:56.559+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:56.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:56.559+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:56.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:56 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:56.559+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:57.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:57.232+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:57.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:57.232+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:57.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:57.232+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:57.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:57.232+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:57.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:57 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:57.232+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:57.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:57.423+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:57.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:57.423+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:57.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:57.423+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:57.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:57.423+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:57.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:57 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:57.423+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:57.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:57.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:57.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:57.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:57.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:57.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:57.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:57.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:57.909 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:57 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:57.596+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:58.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:58.272+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:58.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:58.272+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:58.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:58.272+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:58.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:58.272+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:58.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:58 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:58.272+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:58.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:58.459+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:58.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:58.459+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:58.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:58.459+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:58.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:58.459+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:58.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:58 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:58.459+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:58.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:58.643+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:58.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:58.643+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:58.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:58.643+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:58.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:58.643+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:58.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:58 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:58.643+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:03:59.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:59.287+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:03:59.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:59.287+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:03:59.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:59.287+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:03:59.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:59.287+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:03:59.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:03:59 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:03:59.287+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:03:59.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:59.443+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:03:59.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:59.443+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:03:59.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:59.443+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:03:59.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:59.443+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:03:59.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:03:59 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:03:59.443+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:03:59.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:59.602+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:03:59.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:59.602+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:03:59.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:59.602+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:03:59.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:59.602+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:03:59.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:03:59 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:03:59.602+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:00.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:00.274+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:00.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:00.274+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:00.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:00.274+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:00.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:00.274+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:00.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:00.274+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:00.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:00.447+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:00.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:00.447+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:00.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:00.447+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:00.725 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:00.447+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:00.726 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:00 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:00.447+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:00.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:00.642+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:00.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:00.642+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:00.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:00.642+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:00.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:00.642+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:00.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:00 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:00.642+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:01.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:01.296+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:01.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:01.296+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:01.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:01.296+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:01.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:01.296+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:01.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:01 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:01.296+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:01.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:01.600+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:01.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:01.600+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:01.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:01.600+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:01.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:01.600+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:01.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:01 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:01.600+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:01.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:01.477+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:01.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:01.477+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:01.972 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:01.477+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:01.973 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:01.477+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:01.973 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:01 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:01.477+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:02.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:02.317+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:02.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:02.317+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:02.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:02.317+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:02.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:02.317+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:02.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:02 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:02.317+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:02.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:02.431+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:02.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:02.431+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:02.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:02.431+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:02.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:02.431+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:02.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:02 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:02.431+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:02.808 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:02.553+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:02.809 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:02.553+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:02.809 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:02.553+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:02.809 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:02.553+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:02.809 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:02 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:02.553+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:03.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:03.339+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:03.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:03.339+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:03.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:03.339+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:03.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:03.339+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:03.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:03 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:03.339+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:03.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:03.412+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:03.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:03.412+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:03.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:03.412+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:03.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:03.412+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:03.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:03 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:03.412+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:03.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:03.529+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:03.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:03.529+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:03.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:03.529+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:03.909 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:03.529+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:03.909 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:03 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:03.529+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:04.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:04.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:04.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:04.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:04.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:04.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:04.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:04.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:04.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:04 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:04.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:04.753 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:04 smithi159 podman[71876]: 2024-09-10 08:04:04.475861854 +0000 UTC m=+24.218036544 container died a8a3d0027c927ef5bb6018ce539ca2cc3320e320a0ad60a284283e81404fd0a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T08:04:04.754 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:04.543+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:04.754 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:04.543+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:04.754 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:04.543+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:04.754 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:04.543+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:04.754 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:04 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:04.543+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:04.757 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:04.377+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:04.757 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:04.377+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:04.757 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:04.377+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:04.757 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:04.377+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:04.757 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:04.377+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:05.087 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:04 smithi159 podman[71876]: 2024-09-10 08:04:04.864008155 +0000 UTC m=+24.606182844 container cleanup a8a3d0027c927ef5bb6018ce539ca2cc3320e320a0ad60a284283e81404fd0a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T08:04:05.087 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:04 smithi159 bash[71876]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8 2024-09-10T08:04:05.395 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:05 smithi159 podman[71905]: 2024-09-10 08:04:05.08850803 +0000 UTC m=+0.609301710 container remove a8a3d0027c927ef5bb6018ce539ca2cc3320e320a0ad60a284283e81404fd0a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:04:05.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:05 smithi159 podman[71992]: 2024-09-10 08:04:05.299205967 +0000 UTC m=+0.016341524 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:04:05.657 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:05 smithi159 podman[71992]: 2024-09-10 08:04:05.397608473 +0000 UTC m=+0.114744021 container create 410c72b38a5609e58d1746fcf5f229296449895b6f4aa1cd7b99d46e01c994d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T08:04:05.658 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:05 smithi159 podman[71992]: 2024-09-10 08:04:05.625483129 +0000 UTC m=+0.342618688 container init 410c72b38a5609e58d1746fcf5f229296449895b6f4aa1cd7b99d46e01c994d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:04:05.658 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:05 smithi159 podman[71992]: 2024-09-10 08:04:05.62877989 +0000 UTC m=+0.345915441 container start 410c72b38a5609e58d1746fcf5f229296449895b6f4aa1cd7b99d46e01c994d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-10T08:04:05.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:05.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:05.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:05.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:05.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:05.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:05.659 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:05.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:05.659 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:05 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:05.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:05.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:05.420+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:05.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:05.420+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:05.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:05.420+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:05.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:05.420+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:05.724 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:05 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:05.420+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:05.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:05.406+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:05.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:05.406+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:05.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:05.406+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:05.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:05.406+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:05.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:05 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:05.406+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:06.102 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:05 smithi159 podman[71992]: 2024-09-10 08:04:05.717186538 +0000 UTC m=+0.434322097 container attach 410c72b38a5609e58d1746fcf5f229296449895b6f4aa1cd7b99d46e01c994d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T08:04:06.102 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 10 08:04:05 smithi159 podman[71992]: 2024-09-10 08:04:05.826539114 +0000 UTC m=+0.543674672 container died 410c72b38a5609e58d1746fcf5f229296449895b6f4aa1cd7b99d46e01c994d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T08:04:06.391 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T08:04:06.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:04:06.471 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T08:04:06.471 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T08:04:06.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.9 2024-09-10T08:04:06.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:06.519+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:06.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:06.519+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:06.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:06.519+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:06.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:06.519+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:06.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:06 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:06.519+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:06.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:06.386+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:06.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:06.386+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:06.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:06.386+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:06.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:06.386+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:06.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:06.386+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:06.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:06 smithi073 systemd[1]: Stopping Ceph osd.9 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:04:06.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:06.407+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:06.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:06.407+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:06.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:06.407+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:06.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:06.407+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:06.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:06 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:06.407+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:07.222 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:06.770+0000 7fb9fce86640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:04:07.222 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:06.770+0000 7fb9fce86640 -1 osd.9 97 *** Got signal Terminated *** 2024-09-10T08:04:07.222 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:06 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:06.770+0000 7fb9fce86640 -1 osd.9 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:04:07.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:07.385+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:07.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:07.385+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:07.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:07.385+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:07.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:07.385+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:07.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:07 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:07.385+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:07.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:07.416+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:07.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:07.416+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:07.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:07.416+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:07.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:07.416+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:07.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:07 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:07.416+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:07.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:07.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:07.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:07.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:07.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:07.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:07.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:07.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:07.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:07.526+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:08.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:08.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:08.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:08.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:08.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:08.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:08.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:08.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:08.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:08 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:08.351+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:08.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:08.443+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:08.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:08.443+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:08.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:08.443+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:08.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:08.443+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:08.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:08 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:08.443+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:08.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:08.547+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:08.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:08.547+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:08.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:08.547+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:08.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:08.547+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:08.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:08 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:08.547+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:09.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:09.353+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:09.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:09.353+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:09.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:09.353+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:09.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:09.353+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:09.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:09 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:09.353+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:09.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:09.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:09.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:09.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:09.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:09.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:09.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:09.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:09.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:09 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:09.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:09.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:09.534+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:09.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:09.534+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:09.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:09.534+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:09.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:09.534+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:09.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:09 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:09.534+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:10.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:10.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:10.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:10.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:10.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:10.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:10.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:10.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:10.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:10 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:10.401+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:10.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:10.477+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:10.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:10.477+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:10.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:10.477+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:10.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:10.477+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:10.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:10 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:10.477+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:10.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:10.498+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:10.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:10.498+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:10.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:10.498+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:10.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:10.498+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:10.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:10 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:10.498+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:11.722 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:11.359+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T07:59:59.493510+0000 front 2024-09-10T07:59:59.493574+0000 (oldest deadline 2024-09-10T08:01:32.097582+0000) 2024-09-10T08:04:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:11.359+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:33.198492+0000 front 2024-09-10T08:00:33.198460+0000 (oldest deadline 2024-09-10T08:02:03.502450+0000) 2024-09-10T08:04:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:11.359+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:09.704316+0000 front 2024-09-10T08:01:09.704492+0000 (oldest deadline 2024-09-10T08:02:39.408357+0000) 2024-09-10T08:04:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:11.359+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:41.109114+0000 front 2024-09-10T08:01:41.109180+0000 (oldest deadline 2024-09-10T08:03:10.113072+0000) 2024-09-10T08:04:11.723 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:11 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9[65895]: 2024-09-10T08:04:11.359+0000 7fb9f948b640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.414049+0000 front 2024-09-10T08:02:15.414015+0000 (oldest deadline 2024-09-10T08:03:44.016618+0000) 2024-09-10T08:04:11.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:11.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:11.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:11.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:11.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:11.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:11.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:11.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:11.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:11 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:11.488+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:11.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:11.474+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:11.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:11.474+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:11.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:11.474+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:11.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:11.474+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:11.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:11 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:11.474+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:12.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:12.464+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:12.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:12.464+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:12.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:12.464+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:12.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:12.464+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:12.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:12 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:12.464+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:12.894 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:12 smithi073 podman[92100]: 2024-09-10 08:04:12.603451368 +0000 UTC m=+5.931472804 container died acde939d94e3ec36284e4093f91e57cc5aacdaf9ac6ad541b259ed8dcbe6641f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T08:04:12.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:12.433+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:12.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:12.433+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:12.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:12.433+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:12.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:12.433+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:12.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:12.433+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:13.222 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:12 smithi073 podman[92100]: 2024-09-10 08:04:12.97096883 +0000 UTC m=+6.298990268 container cleanup acde939d94e3ec36284e4093f91e57cc5aacdaf9ac6ad541b259ed8dcbe6641f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T08:04:13.222 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:12 smithi073 bash[92100]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9 2024-09-10T08:04:13.578 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:13 smithi073 podman[92120]: 2024-09-10 08:04:13.238913766 +0000 UTC m=+0.628239270 container remove acde939d94e3ec36284e4093f91e57cc5aacdaf9ac6ad541b259ed8dcbe6641f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:04:13.833 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:13 smithi073 podman[92209]: 2024-09-10 08:04:13.482153686 +0000 UTC m=+0.015951134 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:04:13.833 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:13 smithi073 podman[92209]: 2024-09-10 08:04:13.606449485 +0000 UTC m=+0.140246936 container create 2f63a4b5d24db764b3a1a966a2400e27433e60c6a4cc22fd93382dab18dccdac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:04:13.833 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:13 smithi073 podman[92209]: 2024-09-10 08:04:13.834064798 +0000 UTC m=+0.367862247 container init 2f63a4b5d24db764b3a1a966a2400e27433e60c6a4cc22fd93382dab18dccdac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T08:04:13.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:13.462+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:13.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:13.462+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:13.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:13.462+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:13.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:13.462+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:13.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:13 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:13.462+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:13.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:13.468+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:13.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:13.468+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:13.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:13.468+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:13.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:13.468+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:13.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:13 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:13.468+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:14.222 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:13 smithi073 podman[92209]: 2024-09-10 08:04:13.837543399 +0000 UTC m=+0.371340847 container start 2f63a4b5d24db764b3a1a966a2400e27433e60c6a4cc22fd93382dab18dccdac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T08:04:14.223 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:13 smithi073 podman[92209]: 2024-09-10 08:04:13.917280963 +0000 UTC m=+0.451078417 container attach 2f63a4b5d24db764b3a1a966a2400e27433e60c6a4cc22fd93382dab18dccdac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T08:04:14.223 INFO:journalctl@ceph.osd.9.smithi073.stdout:Sep 10 08:04:14 smithi073 podman[92209]: 2024-09-10 08:04:14.029868722 +0000 UTC m=+0.563666171 container died 2f63a4b5d24db764b3a1a966a2400e27433e60c6a4cc22fd93382dab18dccdac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T08:04:14.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T08:04:14.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:14.422+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:14.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:14.422+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:14.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:14.422+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:14.626 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:14.422+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:14.627 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:14.422+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:14.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:04:14.651 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T08:04:14.651 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T08:04:14.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.10 2024-09-10T08:04:14.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:14.457+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:14.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:14.457+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:14.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:14.457+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:14.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:14.457+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:14.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:14.457+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:14.909 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:14 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:14.457+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:14.954 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:14 smithi102 systemd[1]: Stopping Ceph osd.10 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:04:15.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:14.955+0000 7f7f736f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:04:15.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:14.955+0000 7f7f736f8640 -1 osd.10 97 *** Got signal Terminated *** 2024-09-10T08:04:15.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:14 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:14.955+0000 7f7f736f8640 -1 osd.10 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:04:15.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:15.420+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:15.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:15.420+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:15.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:15.420+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:15.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:15.420+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:15.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:15.420+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:15.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:15 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:15.420+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:47.820976+0000 front 2024-09-10T08:02:47.820993+0000 (oldest deadline 2024-09-10T08:04:15.323194+0000) 2024-09-10T08:04:15.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:15.455+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:15.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:15.455+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:15.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:15.455+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:15.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:15.455+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:15.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:15.455+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:15.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:15.455+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:16.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:16.454+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:16.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:16.454+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:16.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:16.454+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:16.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:16.454+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:16.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:16.454+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:16.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:16 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:16.454+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:47.820976+0000 front 2024-09-10T08:02:47.820993+0000 (oldest deadline 2024-09-10T08:04:15.323194+0000) 2024-09-10T08:04:16.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:16.408+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:16.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:16.408+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:16.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:16.408+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:16.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:16.408+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:16.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:16.408+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:16.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:16 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:16.408+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:17.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:17.440+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:17.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:17.440+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:17.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:17.440+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:17.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:17.440+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:17.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:17.440+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:17.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:17 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:17.440+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:47.820976+0000 front 2024-09-10T08:02:47.820993+0000 (oldest deadline 2024-09-10T08:04:15.323194+0000) 2024-09-10T08:04:17.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:17.452+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:17.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:17.452+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:17.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:17.452+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:17.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:17.452+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:17.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:17.452+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:17.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:17 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:17.452+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:18.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:18.453+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:18.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:18.453+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:18.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:18.453+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:18.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:18.453+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:18.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:18.453+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:18.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:18 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:18.453+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:47.820976+0000 front 2024-09-10T08:02:47.820993+0000 (oldest deadline 2024-09-10T08:04:15.323194+0000) 2024-09-10T08:04:18.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:18.433+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:18.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:18.434+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:18.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:18.434+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:18.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:18.434+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:18.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:18.434+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:18.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:18.434+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:19.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:19.391+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:19.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:19.391+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:19.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:19.391+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:19.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:19.391+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:19.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:19.391+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:19.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:19 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:19.391+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:19.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:19.481+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:00.401499+0000 front 2024-09-10T08:00:00.401510+0000 (oldest deadline 2024-09-10T08:01:32.104122+0000) 2024-09-10T08:04:19.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:19.481+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.705259+0000 front 2024-09-10T08:00:36.705299+0000 (oldest deadline 2024-09-10T08:02:04.307577+0000) 2024-09-10T08:04:19.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:19.481+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.009093+0000 front 2024-09-10T08:01:10.009120+0000 (oldest deadline 2024-09-10T08:02:36.013089+0000) 2024-09-10T08:04:19.876 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:19.481+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:38.913952+0000 front 2024-09-10T08:01:38.913880+0000 (oldest deadline 2024-09-10T08:03:09.817268+0000) 2024-09-10T08:04:19.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:19.481+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:09.817522+0000 front 2024-09-10T08:02:09.817557+0000 (oldest deadline 2024-09-10T08:03:41.920124+0000) 2024-09-10T08:04:19.877 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:19 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10[60126]: 2024-09-10T08:04:19.481+0000 7f7f6fcfd640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:47.820976+0000 front 2024-09-10T08:02:47.820993+0000 (oldest deadline 2024-09-10T08:04:15.323194+0000) 2024-09-10T08:04:20.907 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:20.431+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:20.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:20.431+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:20.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:20.431+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:20.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:20.431+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:20.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:20.431+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:20.908 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:20 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:20.431+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:21.126 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:20 smithi102 podman[71497]: 2024-09-10 08:04:20.861362821 +0000 UTC m=+6.010268070 container died 671ffeb1a98aec6981a34c820703262fee1649d8a8f05e866837f1571e825454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T08:04:21.480 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:21 smithi102 podman[71497]: 2024-09-10 08:04:21.213703248 +0000 UTC m=+6.362608510 container cleanup 671ffeb1a98aec6981a34c820703262fee1649d8a8f05e866837f1571e825454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:04:21.480 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:21 smithi102 bash[71497]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10 2024-09-10T08:04:21.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:21.393+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:21.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:21.393+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:21.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:21.393+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:21.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:21.393+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:21.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:21.393+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:21.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:21 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:21.393+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:21.824 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:21 smithi102 podman[71511]: 2024-09-10 08:04:21.481174814 +0000 UTC m=+0.617407494 container remove 671ffeb1a98aec6981a34c820703262fee1649d8a8f05e866837f1571e825454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:04:22.083 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:21 smithi102 podman[71601]: 2024-09-10 08:04:21.728212145 +0000 UTC m=+0.015537919 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:04:22.083 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:21 smithi102 podman[71601]: 2024-09-10 08:04:21.840298205 +0000 UTC m=+0.127624014 container create 51aeecdea92f368d1e4c07e35bf45dc5f4cdd9ffa53e0ee7ea84895e305ea0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T08:04:22.083 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:22 smithi102 podman[71601]: 2024-09-10 08:04:22.084348961 +0000 UTC m=+0.371674725 container init 51aeecdea92f368d1e4c07e35bf45dc5f4cdd9ffa53e0ee7ea84895e305ea0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:04:22.376 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:22 smithi102 podman[71601]: 2024-09-10 08:04:22.087703836 +0000 UTC m=+0.375029604 container start 51aeecdea92f368d1e4c07e35bf45dc5f4cdd9ffa53e0ee7ea84895e305ea0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T08:04:22.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:22 smithi102 podman[71601]: 2024-09-10 08:04:22.184273978 +0000 UTC m=+0.471599761 container attach 51aeecdea92f368d1e4c07e35bf45dc5f4cdd9ffa53e0ee7ea84895e305ea0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T08:04:22.377 INFO:journalctl@ceph.osd.10.smithi102.stdout:Sep 10 08:04:22 smithi102 podman[71601]: 2024-09-10 08:04:22.27407386 +0000 UTC m=+0.561399628 container died 51aeecdea92f368d1e4c07e35bf45dc5f4cdd9ffa53e0ee7ea84895e305ea0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T08:04:22.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:22.401+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:22.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:22.401+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:22.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:22.401+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:22.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:22.401+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:22.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:22.401+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:22.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:22 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:22.401+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:22.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T08:04:22.937 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:04:22.938 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T08:04:22.938 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T08:04:22.938 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.11 2024-09-10T08:04:23.239 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:22 smithi159 systemd[1]: Stopping Ceph osd.11 for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:04:23.239 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:23.239+0000 7fa2d6c9b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:04:23.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:23.239+0000 7fa2d6c9b640 -1 osd.11 97 *** Got signal Terminated *** 2024-09-10T08:04:23.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:23.239+0000 7fa2d6c9b640 -1 osd.11 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:04:23.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:23.369+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:23.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:23.369+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:23.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:23.369+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:23.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:23.369+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:23.659 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:23.369+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:23.659 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:23 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:23.369+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:24.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:24.332+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:24.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:24.332+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:24.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:24.332+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:24.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:24.332+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:24.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:24.332+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:24.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:24 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:24.332+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:25.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:25.328+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:25.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:25.328+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:25.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:25.328+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:25.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:25.328+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:25.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:25.328+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:25.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:25 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:25.328+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:26.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:26.327+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:26.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:26.327+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:26.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:26.327+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:26.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:26.327+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:26.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:26.327+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:26.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:26 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:26.327+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:27.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:27.308+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-09-10T08:00:05.164468+0000 front 2024-09-10T08:00:05.164515+0000 (oldest deadline 2024-09-10T08:01:31.868075+0000) 2024-09-10T08:04:27.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:27.308+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-09-10T08:00:36.469417+0000 front 2024-09-10T08:00:36.469336+0000 (oldest deadline 2024-09-10T08:02:06.173129+0000) 2024-09-10T08:04:27.657 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:27.308+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-10T08:01:10.273880+0000 front 2024-09-10T08:01:10.273832+0000 (oldest deadline 2024-09-10T08:02:37.577349+0000) 2024-09-10T08:04:27.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:27.308+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.73:6814 osd.3 since back 2024-09-10T08:01:42.778446+0000 front 2024-09-10T08:01:42.778431+0000 (oldest deadline 2024-09-10T08:03:08.281714+0000) 2024-09-10T08:04:27.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:27.308+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-09-10T08:02:15.083676+0000 front 2024-09-10T08:02:15.083838+0000 (oldest deadline 2024-09-10T08:03:40.985205+0000) 2024-09-10T08:04:27.658 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:27 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11[60795]: 2024-09-10T08:04:27.308+0000 7fa2cf298640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-10T08:02:45.085962+0000 front 2024-09-10T08:02:45.086009+0000 (oldest deadline 2024-09-10T08:04:13.688857+0000) 2024-09-10T08:04:29.122 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:28 smithi159 podman[72095]: 2024-09-10 08:04:28.859102053 +0000 UTC m=+5.722929352 container died b6edacdff93a11fa3273ff869d922f10c2dae4114ef8b06f14fbfb431dff89a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T08:04:29.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:29 smithi159 podman[72095]: 2024-09-10 08:04:29.213970585 +0000 UTC m=+6.077797884 container cleanup b6edacdff93a11fa3273ff869d922f10c2dae4114ef8b06f14fbfb431dff89a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T08:04:29.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:29 smithi159 bash[72095]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11 2024-09-10T08:04:29.798 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:29 smithi159 podman[72111]: 2024-09-10 08:04:29.506963849 +0000 UTC m=+0.650271526 container remove b6edacdff93a11fa3273ff869d922f10c2dae4114ef8b06f14fbfb431dff89a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T08:04:30.101 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:29 smithi159 podman[72197]: 2024-09-10 08:04:29.799526562 +0000 UTC m=+0.100876382 container create fb62b0b1fce5d6b4629ca3310091947296fd9aeedb91de2f75ed7f1917c46e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T08:04:30.101 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:29 smithi159 podman[72197]: 2024-09-10 08:04:29.714558948 +0000 UTC m=+0.015908777 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:04:30.101 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:30 smithi159 podman[72197]: 2024-09-10 08:04:30.026644885 +0000 UTC m=+0.327994705 container init fb62b0b1fce5d6b4629ca3310091947296fd9aeedb91de2f75ed7f1917c46e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:04:30.102 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:30 smithi159 podman[72197]: 2024-09-10 08:04:30.030186812 +0000 UTC m=+0.331536635 container start fb62b0b1fce5d6b4629ca3310091947296fd9aeedb91de2f75ed7f1917c46e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T08:04:30.102 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:30 smithi159 podman[72197]: 2024-09-10 08:04:30.101691991 +0000 UTC m=+0.403041817 container attach fb62b0b1fce5d6b4629ca3310091947296fd9aeedb91de2f75ed7f1917c46e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T08:04:30.407 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 10 08:04:30 smithi159 podman[72197]: 2024-09-10 08:04:30.222308371 +0000 UTC m=+0.523658201 container died fb62b0b1fce5d6b4629ca3310091947296fd9aeedb91de2f75ed7f1917c46e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:04:30.867 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T08:04:30.909 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:04:30.910 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T08:04:30.910 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T08:04:30.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.a 2024-09-10T08:04:31.196 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 08:04:30 smithi073 systemd[1]: Stopping Ceph mds.a for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:04:31.472 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 08:04:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-a[72938]: 2024-09-10T08:04:31.196+0000 7fc49f3ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:04:31.473 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 08:04:31 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-a[72938]: 2024-09-10T08:04:31.196+0000 7fc49f3ff640 -1 mds.a *** got signal Terminated *** 2024-09-10T08:04:35.472 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 08:04:35 smithi073 podman[92325]: 2024-09-10 08:04:35.212648264 +0000 UTC m=+4.096908208 container died 5e538020fa47b11f440b850582174ba3683980ee088608f6fb82a1c849b5bf53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:04:35.863 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 08:04:35 smithi073 podman[92325]: 2024-09-10 08:04:35.638696949 +0000 UTC m=+4.522956893 container cleanup 5e538020fa47b11f440b850582174ba3683980ee088608f6fb82a1c849b5bf53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-10T08:04:35.864 INFO:journalctl@ceph.mds.a.smithi073.stdout:Sep 10 08:04:35 smithi073 bash[92325]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-a 2024-09-10T08:04:36.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T08:04:36.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:04:36.109 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T08:04:36.109 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T08:04:36.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.d 2024-09-10T08:04:36.434 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 08:04:36 smithi073 systemd[1]: Stopping Ceph mds.d for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:04:36.722 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 08:04:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-d[71759]: 2024-09-10T08:04:36.434+0000 7f45193fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:04:36.722 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 08:04:36 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-d[71759]: 2024-09-10T08:04:36.434+0000 7f45193fb640 -1 mds.d *** got signal Terminated *** 2024-09-10T08:04:40.722 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 08:04:40 smithi073 podman[92447]: 2024-09-10 08:04:40.44174147 +0000 UTC m=+4.107710078 container died ec0bbc1f0b4cab443517d264cc30c578cec1f6c956f3f43367fa58213ec068aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T08:04:41.068 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 08:04:40 smithi073 podman[92447]: 2024-09-10 08:04:40.876284435 +0000 UTC m=+4.542253041 container cleanup ec0bbc1f0b4cab443517d264cc30c578cec1f6c956f3f43367fa58213ec068aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T08:04:41.068 INFO:journalctl@ceph.mds.d.smithi073.stdout:Sep 10 08:04:40 smithi073 bash[92447]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-d 2024-09-10T08:04:41.279 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T08:04:41.315 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:04:41.315 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T08:04:41.315 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T08:04:41.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.g 2024-09-10T08:04:41.648 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 08:04:41 smithi073 systemd[1]: Stopping Ceph mds.g for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:04:41.972 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 08:04:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-g[72544]: 2024-09-10T08:04:41.649+0000 7f910839e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:04:41.973 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 08:04:41 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-g[72544]: 2024-09-10T08:04:41.649+0000 7f910839e640 -1 mds.g *** got signal Terminated *** 2024-09-10T08:04:44.796 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 08:04:44 smithi073 podman[92579]: 2024-09-10 08:04:44.496554204 +0000 UTC m=+2.959420823 container died 759da43ef5ecdbc79535dbc905f7c91037265a65a7012dd712619685dcae35b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:04:45.222 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 08:04:44 smithi073 podman[92579]: 2024-09-10 08:04:44.95563779 +0000 UTC m=+3.418504398 container cleanup 759da43ef5ecdbc79535dbc905f7c91037265a65a7012dd712619685dcae35b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-g, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T08:04:45.223 INFO:journalctl@ceph.mds.g.smithi073.stdout:Sep 10 08:04:44 smithi073 bash[92579]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-g 2024-09-10T08:04:45.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T08:04:45.462 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:04:45.463 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T08:04:45.463 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T08:04:45.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.j 2024-09-10T08:04:45.776 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 08:04:45 smithi073 systemd[1]: Stopping Ceph mds.j for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:04:46.222 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 08:04:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-j[71343]: 2024-09-10T08:04:45.776+0000 7f4d2723c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:04:46.222 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 08:04:45 smithi073 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-j[71343]: 2024-09-10T08:04:45.776+0000 7f4d2723c640 -1 mds.j *** got signal Terminated *** 2024-09-10T08:04:49.785 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 08:04:49 smithi073 podman[92699]: 2024-09-10 08:04:49.513221838 +0000 UTC m=+3.829373474 container died 4e98fc235b7fd3ef1e350480c233b7fc99964502886534a2973e42a0e79d98a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T08:04:50.152 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 08:04:49 smithi073 podman[92699]: 2024-09-10 08:04:49.951798125 +0000 UTC m=+4.267949759 container cleanup 4e98fc235b7fd3ef1e350480c233b7fc99964502886534a2973e42a0e79d98a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:04:50.152 INFO:journalctl@ceph.mds.j.smithi073.stdout:Sep 10 08:04:49 smithi073 bash[92699]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-j 2024-09-10T08:04:50.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T08:04:50.399 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:04:50.400 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T08:04:50.400 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T08:04:50.400 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.b 2024-09-10T08:04:50.705 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 08:04:50 smithi102 systemd[1]: Stopping Ceph mds.b for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:04:51.126 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 08:04:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b[65355]: 2024-09-10T08:04:50.705+0000 7fd3d4047640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:04:51.126 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 08:04:50 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b[65355]: 2024-09-10T08:04:50.705+0000 7fd3d4047640 -1 mds.b *** got signal Terminated *** 2024-09-10T08:04:55.021 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 08:04:54 smithi102 podman[71715]: 2024-09-10 08:04:54.720679518 +0000 UTC m=+4.124606712 container died 02686c4ab49080e2b23c27100ab1f548638bdbe8389fe139b9c1777b43c11cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:04:55.376 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 08:04:55 smithi102 podman[71715]: 2024-09-10 08:04:55.196639579 +0000 UTC m=+4.600566766 container cleanup 02686c4ab49080e2b23c27100ab1f548638bdbe8389fe139b9c1777b43c11cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T08:04:55.376 INFO:journalctl@ceph.mds.b.smithi102.stdout:Sep 10 08:04:55 smithi102 bash[71715]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-b 2024-09-10T08:04:55.633 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T08:04:55.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:04:55.669 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T08:04:55.670 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T08:04:55.670 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.e 2024-09-10T08:04:55.983 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:04:55 smithi102 systemd[1]: Stopping Ceph mds.e for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:04:56.376 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:04:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e[64745]: 2024-09-10T08:04:55.983+0000 7f8fb51b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:04:56.376 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:04:55 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e[64745]: 2024-09-10T08:04:55.983+0000 7f8fb51b3640 -1 mds.e *** got signal Terminated *** 2024-09-10T08:04:59.876 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:04:59 smithi102 podman[71838]: 2024-09-10 08:04:59.578430971 +0000 UTC m=+3.690358734 container died 805291d919c298e8a272e2f59f57946cb1dfe305c8a166df474d815dcd917955 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T08:05:00.309 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:05:00 smithi102 podman[71838]: 2024-09-10 08:05:00.109317426 +0000 UTC m=+4.221245220 container cleanup 805291d919c298e8a272e2f59f57946cb1dfe305c8a166df474d815dcd917955 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T08:05:00.309 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:05:00 smithi102 bash[71838]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e 2024-09-10T08:05:00.543 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T08:05:00.564 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:05:00 smithi102 podman[71850]: 2024-09-10 08:05:00.310620239 +0000 UTC m=+0.732547095 container remove 805291d919c298e8a272e2f59f57946cb1dfe305c8a166df474d815dcd917955 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:05:00.564 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:05:00 smithi102 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-10T08:05:00.565 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:05:00 smithi102 systemd[1]: Stopped Ceph mds.e for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T08:05:00.565 INFO:journalctl@ceph.mds.e.smithi102.stdout:Sep 10 08:05:00 smithi102 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.e.service: Consumed 1.091s CPU time. 2024-09-10T08:05:00.575 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:05:00.575 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T08:05:00.576 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T08:05:00.576 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.h 2024-09-10T08:05:00.876 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 08:05:00 smithi102 systemd[1]: Stopping Ceph mds.h for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:05:01.376 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 08:05:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-h[65048]: 2024-09-10T08:05:00.904+0000 7f97d8397640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:05:01.376 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 08:05:00 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-h[65048]: 2024-09-10T08:05:00.904+0000 7f97d8397640 -1 mds.h *** got signal Terminated *** 2024-09-10T08:05:03.775 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 08:05:03 smithi102 podman[71961]: 2024-09-10 08:05:03.386427729 +0000 UTC m=+2.593656716 container died 0b6b6cbd4ef39da1c1c53a51e9015d1b41136fea7eed86091f71cd413d6c6d58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:05:04.072 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 08:05:03 smithi102 podman[71961]: 2024-09-10 08:05:03.863081363 +0000 UTC m=+3.070310350 container cleanup 0b6b6cbd4ef39da1c1c53a51e9015d1b41136fea7eed86091f71cd413d6c6d58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:05:04.072 INFO:journalctl@ceph.mds.h.smithi102.stdout:Sep 10 08:05:03 smithi102 bash[71961]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-h 2024-09-10T08:05:04.295 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T08:05:04.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:05:04.328 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T08:05:04.328 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T08:05:04.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.k 2024-09-10T08:05:04.626 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 08:05:04 smithi102 systemd[1]: Stopping Ceph mds.k for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:05:05.126 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 08:05:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-k[64432]: 2024-09-10T08:05:04.641+0000 7f6abec0b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:05:05.126 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 08:05:04 smithi102 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-k[64432]: 2024-09-10T08:05:04.641+0000 7f6abec0b640 -1 mds.k *** got signal Terminated *** 2024-09-10T08:05:06.700 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 08:05:06 smithi102 podman[72084]: 2024-09-10 08:05:06.410880552 +0000 UTC m=+1.860852215 container died 2239ec040b2205ddfba1fdbe54d69277c6323956c95ac2b16c54d327f2c6542d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:05:07.033 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 08:05:06 smithi102 podman[72084]: 2024-09-10 08:05:06.800574475 +0000 UTC m=+2.250546135 container cleanup 2239ec040b2205ddfba1fdbe54d69277c6323956c95ac2b16c54d327f2c6542d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T08:05:07.034 INFO:journalctl@ceph.mds.k.smithi102.stdout:Sep 10 08:05:06 smithi102 bash[72084]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-k 2024-09-10T08:05:07.178 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T08:05:07.213 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:05:07.213 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T08:05:07.213 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T08:05:07.214 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.c 2024-09-10T08:05:07.512 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:07 smithi159 systemd[1]: Stopping Ceph mds.c for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:05:07.772 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c[65821]: 2024-09-10T08:05:07.512+0000 7ffa85e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:05:07.773 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:07 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c[65821]: 2024-09-10T08:05:07.512+0000 7ffa85e00640 -1 mds.c *** got signal Terminated *** 2024-09-10T08:05:11.795 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:11 smithi159 podman[72299]: 2024-09-10 08:05:11.528322733 +0000 UTC m=+4.124823659 container died 6c194b5f1bea8fe7c7195dd8c30bceec31e57db743f13541f32db3fbe14c8284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:05:12.138 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:11 smithi159 podman[72299]: 2024-09-10 08:05:11.954550971 +0000 UTC m=+4.551051897 container cleanup 6c194b5f1bea8fe7c7195dd8c30bceec31e57db743f13541f32db3fbe14c8284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True) 2024-09-10T08:05:12.138 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:11 smithi159 bash[72299]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c 2024-09-10T08:05:12.376 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T08:05:12.398 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:12 smithi159 podman[72323]: 2024-09-10 08:05:12.139203443 +0000 UTC m=+0.610181152 container remove 6c194b5f1bea8fe7c7195dd8c30bceec31e57db743f13541f32db3fbe14c8284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T08:05:12.398 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:12 smithi159 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-10T08:05:12.398 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:12 smithi159 systemd[1]: Stopped Ceph mds.c for c025e280-6f47-11ef-bcea-c7b262605968. 2024-09-10T08:05:12.399 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 10 08:05:12 smithi159 systemd[1]: ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.c.service: Consumed 1.089s CPU time. 2024-09-10T08:05:12.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:05:12.412 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T08:05:12.413 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T08:05:12.413 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.f 2024-09-10T08:05:12.657 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 08:05:12 smithi159 systemd[1]: Stopping Ceph mds.f for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:05:13.157 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 08:05:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-f[65518]: 2024-09-10T08:05:12.758+0000 7f05de04f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:05:13.157 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 08:05:12 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-f[65518]: 2024-09-10T08:05:12.758+0000 7f05de04f640 -1 mds.f *** got signal Terminated *** 2024-09-10T08:05:14.141 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 08:05:13 smithi159 podman[72430]: 2024-09-10 08:05:13.853603507 +0000 UTC m=+1.213608843 container died 4eb1658c4f8e8842f402473690efcde2f4ce82b94a517d5719a31d5c0ae535ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:05:14.407 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 08:05:14 smithi159 podman[72430]: 2024-09-10 08:05:14.217207889 +0000 UTC m=+1.577213234 container cleanup 4eb1658c4f8e8842f402473690efcde2f4ce82b94a517d5719a31d5c0ae535ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:05:14.407 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 10 08:05:14 smithi159 bash[72430]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-f 2024-09-10T08:05:14.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T08:05:14.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:05:14.681 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T08:05:14.682 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T08:05:14.682 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.i 2024-09-10T08:05:15.016 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 08:05:14 smithi159 systemd[1]: Stopping Ceph mds.i for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:05:15.407 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 08:05:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-i[66123]: 2024-09-10T08:05:15.016+0000 7f1888bfb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:05:15.407 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 08:05:15 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-i[66123]: 2024-09-10T08:05:15.016+0000 7f1888bfb640 -1 mds.i *** got signal Terminated *** 2024-09-10T08:05:17.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 08:05:17 smithi159 podman[72554]: 2024-09-10 08:05:17.560376937 +0000 UTC m=+2.661119506 container died 812aef7b875d0e68c269b283f4a895b2ee0ec63450251de6d832b365d73a16c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True) 2024-09-10T08:05:18.157 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 08:05:17 smithi159 podman[72554]: 2024-09-10 08:05:17.920747971 +0000 UTC m=+3.021490527 container cleanup 812aef7b875d0e68c269b283f4a895b2ee0ec63450251de6d832b365d73a16c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T08:05:18.157 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 10 08:05:17 smithi159 bash[72554]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-i 2024-09-10T08:05:18.302 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T08:05:18.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:05:18.334 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T08:05:18.335 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T08:05:18.335 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.l 2024-09-10T08:05:18.779 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 10 08:05:18 smithi159 systemd[1]: Stopping Ceph mds.l for c025e280-6f47-11ef-bcea-c7b262605968... 2024-09-10T08:05:18.780 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 10 08:05:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-l[65215]: 2024-09-10T08:05:18.657+0000 7fecdb289640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:05:18.780 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 10 08:05:18 smithi159 ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-l[65215]: 2024-09-10T08:05:18.657+0000 7fecdb289640 -1 mds.l *** got signal Terminated *** 2024-09-10T08:05:19.999 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 10 08:05:19 smithi159 podman[72672]: 2024-09-10 08:05:19.741207092 +0000 UTC m=+1.184479653 container died 1630eb3d517aa3896f88a6aeb9321d4869c7d9dd66f5d9b9058e9afe3e02a144 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True) 2024-09-10T08:05:20.366 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 10 08:05:20 smithi159 podman[72672]: 2024-09-10 08:05:20.108100236 +0000 UTC m=+1.551372795 container cleanup 1630eb3d517aa3896f88a6aeb9321d4869c7d9dd66f5d9b9058e9afe3e02a144 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T08:05:20.367 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 10 08:05:20 smithi159 bash[72672]: ceph-c025e280-6f47-11ef-bcea-c7b262605968-mds-l 2024-09-10T08:05:20.487 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c025e280-6f47-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T08:05:20.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:05:20.519 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T08:05:20.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c025e280-6f47-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T08:05:20.722 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T08:05:23.257 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c025e280-6f47-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T08:05:23.460 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T08:05:25.895 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c025e280-6f47-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T08:05:26.097 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T08:05:28.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:05:28.513 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:05:28.543 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:05:28.571 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T08:05:28.573 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872/remote/smithi073/crash 2024-09-10T08:05:28.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/crash -- . 2024-09-10T08:05:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:tar: /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T08:05:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:tar: Error is not recoverable: exiting now 2024-09-10T08:05:28.646 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872/remote/smithi102/crash 2024-09-10T08:05:28.647 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/crash -- . 2024-09-10T08:05:28.694 INFO:teuthology.orchestra.run.smithi102.stderr:tar: /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T08:05:28.694 INFO:teuthology.orchestra.run.smithi102.stderr:tar: Error is not recoverable: exiting now 2024-09-10T08:05:28.696 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872/remote/smithi159/crash 2024-09-10T08:05:28.697 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/crash -- . 2024-09-10T08:05:28.776 INFO:teuthology.orchestra.run.smithi159.stderr:tar: /var/lib/ceph/c025e280-6f47-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T08:05:28.776 INFO:teuthology.orchestra.run.smithi159.stderr:tar: Error is not recoverable: exiting now 2024-09-10T08:05:28.777 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T08:05:28.778 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T08:05:28.827 INFO:tasks.cephadm:Compressing logs... 2024-09-10T08:05:28.828 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:05:28.830 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:05:28.832 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:05:28.855 INFO:teuthology.orchestra.run.smithi073.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T08:05:28.855 INFO:teuthology.orchestra.run.smithi073.stderr:: No such file or directory 2024-09-10T08:05:28.855 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T08:05:28.855 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T08:05:28.858 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T08:05:28.858 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T08:05:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T08:05:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T08:05:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T08:05:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T08:05:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log 2024-09-10T08:05:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T08:05:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T08:05:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log: /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T08:05:28.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T08:05:28.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T08:05:28.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 86.7% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T08:05:28.865 INFO:teuthology.orchestra.run.smithi073.stderr: 95.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T08:05:28.865 INFO:teuthology.orchestra.run.smithi073.stderr: 95.1% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T08:05:28.866 INFO:teuthology.orchestra.run.smithi073.stderr: 95.2% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T08:05:28.866 INFO:teuthology.orchestra.run.smithi073.stderr: 95.2% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T08:05:28.871 INFO:teuthology.orchestra.run.smithi073.stderr: 84.5% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T08:05:28.874 INFO:teuthology.orchestra.run.smithi102.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T08:05:28.875 INFO:teuthology.orchestra.run.smithi102.stderr:: No such file or directory 2024-09-10T08:05:28.875 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T08:05:28.875 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T08:05:28.875 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T08:05:28.876 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T08:05:28.876 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T08:05:28.876 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T08:05:28.876 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T08:05:28.876 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T08:05:28.876 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T08:05:28.876 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T08:05:28.877 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.cephadm.log: 81.8% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T08:05:28.877 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log 2024-09-10T08:05:28.877 INFO:teuthology.orchestra.run.smithi102.stderr: 95.1% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T08:05:28.877 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T08:05:28.877 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log: 91.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T08:05:28.877 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T08:05:28.877 INFO:teuthology.orchestra.run.smithi102.stderr: 86.7% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log.gz/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.h.log: 2024-09-10T08:05:28.880 INFO:teuthology.orchestra.run.smithi159.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T08:05:28.881 INFO:teuthology.orchestra.run.smithi159.stderr:: No such file or directory 2024-09-10T08:05:28.881 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T08:05:28.881 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T08:05:28.881 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T08:05:28.881 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T08:05:28.881 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T08:05:28.882 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T08:05:28.882 INFO:teuthology.orchestra.run.smithi159.stderr: 81.8% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T08:05:28.882 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T08:05:28.882 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log 2024-09-10T08:05:28.882 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T08:05:28.882 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T08:05:28.882 INFO:teuthology.orchestra.run.smithi159.stderr: 86.7% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T08:05:28.882 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T08:05:28.883 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip 95.1% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T08:05:28.883 INFO:teuthology.orchestra.run.smithi159.stderr: -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T08:05:28.883 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.8.log: -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T08:05:28.883 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mgr.z.log: 95.1% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T08:05:28.883 INFO:teuthology.orchestra.run.smithi159.stderr: 91.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T08:05:28.883 INFO:teuthology.orchestra.run.smithi159.stderr: 91.9% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T08:05:28.883 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T08:05:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T08:05:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T08:05:28.884 INFO:teuthology.orchestra.run.smithi159.stderr: 95.1% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T08:05:28.884 INFO:teuthology.orchestra.run.smithi159.stderr: 95.2% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T08:05:28.885 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T08:05:28.885 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T08:05:28.886 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T08:05:28.886 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.e.log: 95.1% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T08:05:28.886 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T08:05:28.918 INFO:teuthology.orchestra.run.smithi073.stderr: 93.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T08:05:28.949 INFO:teuthology.orchestra.run.smithi073.stderr: 90.4% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T08:05:29.117 INFO:teuthology.orchestra.run.smithi073.stderr: 91.1% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T08:05:29.126 INFO:teuthology.orchestra.run.smithi159.stderr: 91.8% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T08:05:29.133 INFO:teuthology.orchestra.run.smithi073.stderr: 90.3% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T08:05:29.269 INFO:teuthology.orchestra.run.smithi102.stderr: 91.9% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T08:05:29.810 INFO:teuthology.orchestra.run.smithi073.stderr: 90.5% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T08:05:29.868 INFO:teuthology.orchestra.run.smithi102.stderr: 96.2% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T08:05:38.281 INFO:teuthology.orchestra.run.smithi102.stderr: 94.8% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T08:05:39.596 INFO:teuthology.orchestra.run.smithi073.stderr: 93.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T08:05:42.090 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T08:05:42.109 INFO:teuthology.orchestra.run.smithi159.stderr: 93.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T08:05:43.397 INFO:teuthology.orchestra.run.smithi159.stderr: 93.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T08:05:43.774 INFO:teuthology.orchestra.run.smithi159.stderr: 93.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T08:05:45.471 INFO:teuthology.orchestra.run.smithi102.stderr: 93.1% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T08:05:47.761 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T08:05:48.269 INFO:teuthology.orchestra.run.smithi159.stderr: 93.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T08:05:48.271 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-09-10T08:05:48.271 INFO:teuthology.orchestra.run.smithi159.stderr:real 0m19.423s 2024-09-10T08:05:48.271 INFO:teuthology.orchestra.run.smithi159.stderr:user 1m0.084s 2024-09-10T08:05:48.271 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m2.205s 2024-09-10T08:05:49.931 INFO:teuthology.orchestra.run.smithi102.stderr: 93.1% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T08:05:49.933 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-10T08:05:49.933 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m21.087s 2024-09-10T08:05:49.933 INFO:teuthology.orchestra.run.smithi102.stderr:user 1m17.972s 2024-09-10T08:05:49.934 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m2.573s 2024-09-10T08:05:50.876 INFO:teuthology.orchestra.run.smithi073.stderr: 93.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T08:05:54.802 INFO:teuthology.orchestra.run.smithi073.stderr: 92.9% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T08:05:57.018 INFO:teuthology.orchestra.run.smithi073.stderr: 93.0% -- replaced with /var/log/ceph/c025e280-6f47-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T08:05:57.020 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-10T08:05:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m28.176s 2024-09-10T08:05:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:user 1m7.763s 2024-09-10T08:05:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m2.473s 2024-09-10T08:05:57.021 INFO:tasks.cephadm:Archiving logs... 2024-09-10T08:05:57.022 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872/remote/smithi073/log 2024-09-10T08:05:57.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:06:07.682 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872/remote/smithi102/log 2024-09-10T08:06:07.683 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:06:18.607 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872/remote/smithi159/log 2024-09-10T08:06:18.608 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:06:28.081 INFO:tasks.cephadm:Removing cluster... 2024-09-10T08:06:28.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c025e280-6f47-11ef-bcea-c7b262605968 --force 2024-09-10T08:06:28.285 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T08:06:28.895 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c025e280-6f47-11ef-bcea-c7b262605968 --force 2024-09-10T08:06:29.095 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T08:06:29.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c025e280-6f47-11ef-bcea-c7b262605968 --force 2024-09-10T08:06:29.652 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: c025e280-6f47-11ef-bcea-c7b262605968 2024-09-10T08:06:30.059 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T08:06:30.059 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T08:06:30.078 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T08:06:30.095 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T08:06:30.111 INFO:tasks.cephadm:Teardown complete 2024-09-10T08:06:30.112 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T08:06:30.122 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T08:06:30.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:06:30.125 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:06:30.137 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:06:30.242 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T08:06:30.265 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T08:06:30.266 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:06:30.275 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:06:30.286 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:06:30.290 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:06:30.297 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:06:30.298 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-10T08:06:30.298 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +2152us[+2083us] +/- 47ms 2024-09-10T08:06:30.298 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +2533us[+2533us] +/- 72ms 2024-09-10T08:06:30.298 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 -6773us[-6842us] +/- 85ms 2024-09-10T08:06:30.298 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:06:30.299 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:06:30.301 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:06:30.302 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-10T08:06:30.302 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +2156us[+2075us] +/- 48ms 2024-09-10T08:06:30.302 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +2604us[+2498us] +/- 72ms 2024-09-10T08:06:30.302 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -6685us[-6791us] +/- 85ms 2024-09-10T08:06:30.302 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:06:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:06:30.314 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:06:30.314 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-10T08:06:30.314 INFO:teuthology.orchestra.run.smithi159.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +1715us[+1699us] +/- 47ms 2024-09-10T08:06:30.314 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 128 +2194us[+2219us] +/- 71ms 2024-09-10T08:06:30.315 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 -7197us[-7213us] +/- 85ms 2024-09-10T08:06:30.315 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:06:30.316 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T08:06:30.643 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T08:06:30.643 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T08:06:31.340 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:06:31.742 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:06:31.817 DEBUG:teuthology.orchestra.run.smithi159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:06:31.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:06:31.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:06:31.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:06:31.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:06:31.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:06:31.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:06:31.987 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T08:06:32.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T08:06:32.860 INFO:teuthology.task.internal:Duration was 1994.411606 seconds 2024-09-10T08:06:32.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T08:06:32.891 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T08:06:32.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:06:32.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:06:32.896 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:06:32.941 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:06:32.942 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:06:33.078 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:06:33.464 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T08:06:33.464 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-10T08:06:33.464 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:06:33.489 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-10T08:06:33.489 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:06:33.522 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T08:06:33.522 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:06:33.552 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T08:06:33.552 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:06:33.555 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:06:33.565 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:06:33.619 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T08:06:33.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:06:33.627 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:06:33.633 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:06:34.096 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T08:06:34.107 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T08:06:34.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:06:34.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:06:34.157 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:06:34.183 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T08:06:34.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:06:34.197 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:06:34.200 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:06:34.217 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-10T08:06:34.221 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-10T08:06:34.247 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2024-09-10T08:06:34.271 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:06:34.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:06:34.287 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:06:34.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:06:34.311 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:06:34.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:06:34.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T08:06:34.337 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T08:06:34.338 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872/remote/smithi073 2024-09-10T08:06:34.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:06:34.381 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872/remote/smithi102 2024-09-10T08:06:34.381 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:06:34.417 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898872/remote/smithi159 2024-09-10T08:06:34.418 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:06:34.454 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T08:06:34.454 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:06:34.457 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:06:34.459 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:06:34.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T08:06:34.518 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T08:06:34.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T08:06:34.528 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T08:06:34.529 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:06:34.531 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:06:34.533 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:06:34.544 INFO:teuthology.orchestra.run.smithi073.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:06 /home/ubuntu/cephtest 2024-09-10T08:06:34.547 INFO:teuthology.orchestra.run.smithi102.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:06 /home/ubuntu/cephtest 2024-09-10T08:06:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:06 /home/ubuntu/cephtest 2024-09-10T08:06:34.559 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T08:06:34.571 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T08:06:34.602 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} duration: 1994.411606311798 failure_reason: 'Command failed (workunit test suites/ffsb.sh) on smithi073 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh''' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3b82613308c44a128011ad357b722a86 status: fail success: false 2024-09-10T08:06:34.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T08:06:34.697 INFO:teuthology.run:FAIL